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[ # m m * o m m ] 
[f»** 1 ] 

3. - if - m it © 4s {* # * ft * is bu s^ff.:Ri-r*i»i«i:» m ib * is bu m m © '> ft < t 

fe 1 o © ffi # ft* 6> '> 4 < *> 1 oOT^J'JXiCiOaS^nftf iRfc*amtSXf 
y 7" £ > 

to ta * m su » ^ e. tt tii 2? ft it m m © '> ft < 1 1 - mt , »qstae©*r£-r§i9?B«:#tr 

IK x - * - X * ffl !/•> T , MIE*ISSUil^©Ji&*llBU%J*5£t-;g>Xxy7°^ 

tu IB ^ * < fe 1 o © 7 )V =f U X A tc «fc 0 i* 3£ 5 ft § til t ffl * t> t ft M IB 1* ffi © '> 

* < t t> - SB co «■ 4? tc S t3 < M IB Ji ii * IK BU , ¥ - © * qs S « «■ & * © ft ffl T? M B'J L 10 

rc m & k m bb * n bu m as * m m t % x t- y -? t , * # tr 77 a . 
[ » * fli 2 ] 

19 ib m bu 7* - 2 ^ - x w m bu -9- - e x • ^a/w^titifisntfe!), 

MiaSgXr-y^tf, m SB * US 530 m % K M IE M M V - tT X • 7 d / W 5 - it ft IK J3U ? 

n m it r 3 ft r ^5 it « tti ia - m m bu ? «• ffl ^ > x « m e * m m n « fc t- * x h^ii 
jg # u ft -: ^ * ii ^ « m bb * » BU m & k m m h it e. ft t ^ s m ta -r x h * ^ s , m 

* rR 1 ic IB IS © -ft & „ 

[ Sff * Ift 3 ] 

£ 0 hu IB si ^JJ * « IE f 5 X r- y £ H tc $ t? , W * 2 ic IB «Sc o 73 ffi 0 20 
[ IS * « 4 ] 

Sft IB * ^ BU II # tc SI X # if p. ft W IB 7- * X h m SB » « <D 7 r << )\> * * $ tr , If * 3 

IB «t © 73 o 

im&m 5 ] 

iju ia * m m mgicMMttif znrcftimT** btfrnmrngo i d 3 ^ 9 $i t? > m * £ 3 

lc IE © 7? „ 

[ n * « 6 ] 

w ib '> & < fc t 1 o©7;i-3i;xA(a q j tifciiRtf , w 12 * m m m m v> & * < t 

6 1 O CO gp # © ^ ^ fc «k tf tf -r - * If $R CO '> * < t fe - * 5 a W 5 ft « > f * * 1 IE «c 

CO 73 c 30 

c w * a 7 ] 

M IB ^ * < J: 1 o © 7 ,1 ri - U X U tc «fc D ^ 5£ * ft g 1R ^ ft < tt)20«g|!l:§* 

WE«»JX*yyj^#^o«fflfi^Wia¥--IS*P»«*li9J-r*fc«)KWIB*a< i: fe 2 
oofttOft^r^^Iit?, W*aitcIE«cD7?ffi 0 
[ If * IS 8 ] 

hu ib * is ii e <d ffl ffl s ft tc m ■$ * m ib m - s * is § © « # ? ft rc s ? t it k -r § c t 

* 0 M IE IS 3eiJ X -r -v 7 s * ^ II f § X x <y 7° * M $ €y , If * « 1 IE tg © 77 jsfe . 
[ IS * a 9 ] 

«»©a-tr-fr5©ffl»©*»SUMf;:o^Tmffi*flffl, IS BU © # X x y 7° * « 40 

Sfl IE * IS 8U 815 * © ^ gij © ^ & *g ^- § X v 7° i: , 

^DcD^^--v^^faIEllBU7 1 '-^^-Xtc$Sftf#SS3A^^D^^fflTSX^'y7 0 i; 
» * H tc tr > W M m 8 ic IE «c co 73 S = 
[ If * a 1 0 ] 

AO IE SS tl X » -y 7° M SB 3. - if - e, % M IE IS BU X -r y 7° ^ ^ IE S8 ft C t Z ^ f 1f % S 
It5Xf7 7'*^tf, If * ^ 9 tC IE £c CO 7? ffi 0 

[ M * 9 1 . ] 

m ib e m x * -y 7° a . m ia be x t- y 7° # $ * l ft *> rc m & > 15 ib '> ft < 1 1 1 u © 7 

;P 3 'J X A t: <fc 0 j* 5£ S ft fc S » i: Su IE ¥ - £ 2p « « <D m BU ? i: * U ft t % X f y 7 s * # 50 
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2* , 

M-o)mffl?icti lt mmfticmz: 5 ^ & tf « # ? ft t ^ zm&iz * m is m su ? - * ^ - 

x tu IB il & ^ 9 tf £ 5 £ t?:itXf-yy*MKtO, ft *9 9 I:i2f ©TjSo 

[ m * m i 2 ] 

m ie 'P & < 1 1 i o o r ^ =f y x a £ d ft £ $ ft re ^ & tf tu ib a *ts is * <d 1 o tc a -r 
§ tf , WIE*»S'JS«fi:«S(jae^Scbr£:io©sq!Sgot,ofc{iaftS i D3^'fll 
tf B8 * # ft T V> £ « ^ K > SufaMiA^i^D>&^1-X7 L -y7 p ^Sfc-&ty. If 5}c JS 9 1 2 

[ if * m i 3 ] 

tuta*liBUii^^Sttm$ftrcWffitca^^TMfBliiA^^i3%ITIE-r?.X7--y7 0 ^S(c 

3- ty , IS 3< 9i 9 k la «t <d 73 ft o 
[ m at. * i 4 ] 

itij fa '> & < t £> l o co 7 ;!/ =T U X A <fc D ft 5£ ■£ ft fe W & tf *u IB S S * © 5 "6 © - "3 ^ 

n s w (c iiih 1 5 *\ m la * is bu s e tf s » m n w t s * § 1» « tf m m s ft fc « t , m 

IS m BU t* - * ^ - X tc ft 5i * 8§ 0 * ^ f X -r -y 7° * H fc $ tr , W#^8fc|a«(D73^o 

*^fc«ttf3.--9 , -jc«tsi»f^%swfc it, hu ta * m bu n e t a 46 e. ft f* - * * m 
m -r ^ < fit iia * as bu s g t im a -r § x - * * m s 7* - * ^ - x 5 sa is -r § x f -y 7 * JE 

tc # t? , f» * ^ 1 tc IB * <D 73 ft o 

imMm \ 6 ] 

il^^§KBUlT373ftT?&oT, 

fflgE*W3iJMtf5fflajSftfcg*fc©5-£©'>&< 20ti!pSf CW(5LTftfi8S 
tx fc Si * ^ t? 4> * < £ fe 1 -3 © -r - 2 ^ - X i: ffl T bu HB * ffi BU ® m <D M )i * M BU 
StSt5Xfy7"t, 

m m » % * m m t % x f >y ^ t , * # t? 73 a . 
[ n $ a 1 7 ] 

§ W & # BU IB * m SU 85 a © '> ^ < t io<DJB5»<D§^*i«J:a : vf7**1f?H©^ft< t t, - 
73*^^4t±l^ft ; S>^ W3R«1 6fCfa«073ffio 
[ 3ft * ^ 1 8 ] 

BU X r «y 7° * ^ IE t 5 X t- «y 7 * S tc fs > W * * 1 6 lc f B «c « 73 ft . 

[ m & m i 9 ] 

M IB ft JE , mm. <fc $ SI co § X =r v X *H IK BU V - V X • 7° u / W 9 <D flpj »TK*S '> 
^< i: t l ocr>+J--A-tc<fct)*ff^ftx 

W IB tt IE X x v 7 fig * L fc ^ Tf nu ,1B '>^< i: t. 1 oco^t-M-ft^tSId? 5 ^ 7 y h 8 
B 's f ij IB # - a * it « HI a # it 5. ft fc - K & % BU ? * iM ffi "T « X r -y 7 i: > 

m is — ^ gu ^ ^ m ib z =7 4 r > v m m <d m ib * m su « k m a ft w- § x t- y f t , 

S fT tf , II * II 1 8 IB « CD 73 ft o 
[ M * « 2 0 ] 

W IB — M M Wi =f * > M IB '> & < i: €. 1 o cd -r 1 - ^ ^ - X tc « # $ n fc IK BU ic m t 5 ff nj 

*S IB iff nj U X h fC fiu IB - « « S'J ¥ IC ? Z> t, CD tf * £ i§ > hu IB U fi tf « W T'tSCi 
5gtXf77t, ^StC-g-t?, W * ^ 1 9tClBicCD73?S 0 
[ If * * 2 1 ] 

W IB - M M BU ^ * tu IB '> * < £ 10CDT ? -^^-XtC«#^ft/S:iSSiJ?cD7*a-y^ • U 
X h tttlf5Xr77't, 
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iff IB 7* n y ? • V X h tc tu IB - M m 3U ? tc & f § O £ 3 if , 10 IB S 8 « # T* t 
5l'a?itXf77*t, H tc # ty , Sf*JSl 9 tc IB « 73 ffi 0 

[ m * m 2 2 ] 

* m 8U « g 3: §1 33U f ^ < HJ ^f.ti*f-?^-X(cffl#?nn^if w $h * f# -r 3 77 

ffi x & o t , 

H 3 # » £ ti /c # Wi B t* - * 12 f# -T § X -r -y 7" i: , 

m I B S m (O '> < tt. l"3©g|57>fr£'>&< fct l o £D & & £ a tH T 3 X -r -y 7° fc , 
WIBv^-^^-XrtT'HulB^jg«T f -^i:-&gt-r5t.©*^tH$nfc^-&, hu IB '> & < i: 
6 lc><D«!lK*ffifB»SOi^1t«fcLT«#*-5X7 i v7*fc, ^ €r 73 ffi o 

tu IB * ffi 7 ! - 2 hu IB «S B O ft £ «r * f , M * ^ 2 2 tc IB WL <D TJ ffi . 

tu IB e ^ I /»-A7*;Mf-f 7(c*^«§?ntfcD, tu IB # ffi J£ t* - * tu IB S S © 
T0C (Table Of Contents) t* - * 5 » 5> ft 3 , If * ^ 2 3 tc IB *ic © 75" ffi = 
[ M * « 2 £ ] 

tu ia # ffi - * # tu ib m § tc n il ft # e. ft tc r * X h * # tr , M * « 2 2 tc IB k © * ffi 

0 

[ m m m 2 e ] 

tu IB #E ffi 7 f - * I D 3 * ^ * # ty , If IB 2 5 tc IB *Jc co 73 ffi . 
2 7 ] 

tu IB I D 3 * '9 & ft ^ ft 1f m It # * > 

tu IB 7* - * 'S - X tu IB m 334 - if X • 7 s n ; W ^ tc J: 0 W II S ft T 43 t) , tu IB W # fb 'If 

tu IB t* - ^ - X £D « »J 1R ffi © « # X t- -V 7° tc $fc i£ o T tu IB «f ^ ft ffi? £K * Ifi ^ ft f § C 
t j; D tu IB B ? - $ * m BE -T § X -r >y 7° H ^ t? , W # « 2 6 (C IB tg O * ffi . 

[ n * m 2 s ] 

tu IB & m 7 r - ^ ^ « ? }S L % ^ tf . If * II 2 5 fC IB « <D 7J ffi . 
[ M * « 2 9 ] 

tu ib ip ffi m 7 r - ^ ^ § as m f* © a is tc n -r s « f* m m * $ t? , w * « 2 5 tc ib « <d 7? ffi „ 

[l*i3C] 

hu ib % f* 'W « # tu ia « m m <o a m * c d - r t l x m m -r z , m&m 2 9 tc ib <s n -n m 

o 

[ if m m 3 1 ] 

tu ib m f* w ffi tu ib « m m w <d m m * c d - d a t l t m su r § , if * a 2 9 tc ib « o 73 
ffi 0 

[ m * * 3 2 ] 

tu IB *K f* W ffi ^' tu IB it ig {« f* <D m m * t* 'J 9 • 7 r ;1/ t L X M SU "T 3 , If * IR 2 9 tc 
IB ic » 7J ffi „ 
[ IS * JS 3 3 ] 

w ib m {* m ffi & m ia ^ ® m w <o m m * dvd c x >>• * ^ ^ s ^ tm x ^ ) tLT»»jt?, 

If * « 2 9 tc IB * « 73 ffi o 

c w * m 3 4 ] 

tuI3 7-^Xh^tulE««cD7ri';l/«^#t?, If*JS2 5tc|E*cD73ffio 

[ if m m 3 5 ] 

tu IB 4=- X h ^ tu IB IS g co ^ 4 b 71/ «: # tf > If * W 2 5 tc IB « © 73 ffi . 

[ m * « 3 e ] 

mUr^x h tfffimm&<DMfti,c&mLrzT-7- 4 x b m & m 2 stciae©?? 

ffi o 

[ M * « 3 7 ] 
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m IB t- * X ffi C U « K BB S 5> n 7c 7 7V M A £ 5: # Cy > Si # IS 2 5KE«O^S, 
[ M * * 3 3 ] 

» s © h * * $ aa o i> x % ft t£ n , ^«:sa-if-*<ftijsESSA^6a*s««s:*aai-r 
s , m * is 2 2 tc IB « © 77 ?s o 
[ m & is 3 9 ] 

^ g ,j +j- _ t x . 7° n © ffrj AS T lc & 3 '> & < t 1 o©+f--A — ±T?t-*— — X£ 

© a f 5 X -r -y 7° i: , 

&U 8H 4> & < & fc l^©-9--><-fr5tu"3E*'7'r7 , >'h»H'N, «^7^7> hSltfSft 
3£***ttm?-*li©Wfcifr^£SflT3X7 L 'y7i:, ^Sfc^-fr, Si * IS 3 8 tc SB « © 
7a j£ ■> 

tu IE ^ 5 T > h S H ti> <b tu SB '> & < i: fe 1 © "9" - ^ ~ ^ tu IB ^ \& T$ -f - £ £ iM fa "T 5 
M fc # K -r - * S -3 v T , tu SB 7 > & < i: t> l oot-^- ic i S ME 7 ^ 7 > h 1 

i^oasixf^iKiiaanj*^*i«tsxf7^i:, £ h ^ # t? , si * is 3 9 ^ 

SB iSc © * ?4 „ 

[ m m m 4 i ] 

t*iat 5Xf >y^*M£^&, Si IS 4 0 k: SB *c © 7a ft o 
[ IS * * 4 2 ] 

SfdBatb^^OWSHS^X^ >y tuSEWtil^^^Sfel-^WfB^V'fT'Vh^Bcoa 
il:'>5:< k&g&^l&Kg'^T^^ Si * IS 4 0 C SB «c © 7a J* . 
[ St * IM 4 3 ] 

m SB tt m fit ft CO fju SB a 8? X r- y 7° *>< , M3BttW#^*Stt-r*ME^9-fTyh8K<0* 
aW{aBfC'>?S:<4:t,S|5«'WfcS , ^^TVS, St * * 4 0 K SB *!c CO 7a ffi . 
[ Si * IS 4 4 ] 

Husattm#^coMsaa«x^-yy^\ mmmtafit^^^mr ^>mm^ -y r > h smxm 
ft s n § v 7 h •> x r K'p * < ktas^WKS-J^T^s, si * is 4 0 tc sb « © * r£ = 
[ si * is 4 5 ] 

t5Xr77°%ltttJ> Si * * 4 o fc SB « © 7a ffi =, 

[ n * * 4 6 ] 

tu S3 M tb A fr co tu SB JS *R X y- v 1 , WES*©*«©fi*fc'>ft< 
T^§, Si * IS 4 0 f B i£ © 7a ?£ 0 
[ Si * H 4 7 ] 

tu sb a m fis ft tc * o ffi s ^ n s b# n ^ , tu ia '> & < 1 1 1 o © « *sc * to sb * -7 << t > h m 

M & M §B 7 > 'S: < fc fc looit-^-'\2S(lt5Xf7^4ICttf, Si*^4 OtciB« 
CO 7a r£ 0 
[ Si * « 4 8 ] 

m je s n rc » co « «: * s tu sb as ft x r- -v 7 s « k m m v # « s -e > tu sa '> * < 1 1 i o © « «: 

^tuSB^^^7'>hS«^fi#-r?.XT--y7 s ^Mtc#Cy, Si*«4 7fcSB«c07affic 
[|*«4 9 ] 

tu SB & < k t. 1 o © -9" - ^ - t co ii ft A^iJ ffl T t? S if ^ , tu SB '> % < 1 o cO § 
£0 tu SB 3^ ffl X f >y 7 s ^ It t> ti § > Si * IS 4 7 SB it <D 7a S = 
[ Si * IS 5 0 ] 

ft © m IB M X v- v 7° *^ > fflEl^O*7^7yh8l^57*tX«nftS = Ofif 
W "T S> #f ift ff5 7 s - * © tu SB ft X -r -y 7° i: & tf t) ti 5 , Si * « 4 7 tc SB «c © 7a }£ « 
[ Si * IS 5 1 ] 
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m ia n % & u A-z^iMfv 7 ic 7 i< a « # s n t > w is 7 5 -r 7 y v m m & ffi ia it b *-> 
ffi ib s t <o & ^ it tc 9t il r> t tu ia m m x 7 >y 7° # ffi ia '> ft < t 1 ooiui^iits, 

IS * 55 A 7 IZ. B ® CD 71 ffi , 
[ IS ;R 51 5 2 ] 

ffi IB S ^ V A - /ST* 71/ ^ 7 s 7 fC 7* X fi! # £ ft T , ffi IB 7 7 --I" 7 > h SiA'ilBia 
& '> ft < tt. 1 0©^P§ ltSnft77'l';l'%4«L, 

ffi IB V A — /•! 7" ;V ^ 7 i- 7 £D 1 O CO T ^ -y ^l^ltLlclT*, ffi IB ft X 7 -y 7° ffi IB 

'> ft < t fe i oo^&^aim-rs, it * 3i 4 7 k ib « © 7? ffi o 

ffi IB IS o ft 5 'J I*-^7;Mf^ 7lc*^«#jnT, ffi IB 7 7 -< 7 > h ^ IS ffi IB S3 g *"> 

& '> ft < fc t i oof §<k*nf:7 7^/i'^4SL, 

ffi IB U Z> - 7* )\> * 7 cd ft % it W % 7 L fz t <D W to * § is L fc 'ilk T? , ffi IB & ffi X 7 «y 
7° '> ft < t. t 1 O <D ^ }M ff -f ^ M * 51 4 7 fC IB « <D 7? ffi o 
[IS*51 5 4 ] 

ffi IB 7 - * 'S - X ^ ft » & tc IB -T 3 itt BU fit « * $ tf , W * J» 2 2 IB lie CD ffi o 

c m * * 5 5 ] 

ffi ib -r — # < — t. # m izm-rz m m w « * ^ o > a*®2 2 tc ia * cd 7? ffi . 

ffi IB '> ft < fc 1 o co « fcfc cd n °p M % tb 7 S X t- >y 7 i: , 20 

ffi IB 'P ft < t t l oObS?:1^T, ffi IB » g co 93U co ffi » ii BU f § X f - -y 7° i: , 

MiE®SOSiJOlfiaa^«tDiSiftKft§lK%^fiK-r5Ji-&fJ:, ffi IB 'P ft < t «. 1 oof t^: 

ffiIBcfcD« n : i J Hft^^i:K^-r?>X7-y7 B i:, ISs)tiM2 2tciaiccD73ffio 

[ M * * 5 7 ] 

ffi IB ^SOttUlXf 77*tf, ffi IB « 0 ^ J4J L fc f ^ ft S ffi CStJ^T ^ 5 , »*«56 
IB « co 73 ffi „ 

[ m # m 5 £ ] 

ffi IB d°p H co tb X f" -y 7° W , ffi IB ® ^ <D « # tc m ^ fc M <D m « fc S r3 V> T V>5 , W * « 
5 6 fc IB So c.) 73 ffi o 

[H*«5£] 30 

ffi IB p°p M CD #! tb X 7 <y 7° ^ , ffi IB S fif 7 <7 -fe X ? 5 a. - If - & ■ CD 18 0 IT IE 14 ffi » r3 

I 1 1 5 , in * 55 5 6 m m co 73 ffi „ 

[ SS * * 6 C ] 

ffi IB 3. - If - « V 7 K 7 x 7 M 0 IT IE t? {± ft < ^ - F 7 x 7 18 <7 IT IE * m ^ fc m & fc 
, ffi IB p°p n V m tb X 7 y 7° ^ ± i? K V p° S * ^ A § , I* * 51 5 9 (C IB « CD 73 ffi o 

[ m m m 6 i ] 

ffi IB p n p K © «$! tb X 7 «y 7° ^ , ffi IB W © ffi IB tt tb X 7 y 7 CD m IC « tb 5 ft M t) cD $k {C S 
C5^TV>§» M * IR 5 6 IB m CD 73 ffi o 

c m * « 6 2 ] 

ffi IB IK ft ft tb X 7 y 7° tf, ffi IB fit § <D S ft S ffi S tc o ^ T ffi & cD a - if - m S 7 40 

5^7^7i'TSfi(cJ;D*fT$ft, 

ffi IB 3- - if - CD 1 A 5 IX If « ft fc ffi IB 'P ft < i: t 1 OOftt*, '> ft < £ 1 A CD gij <D 
3. - -9 s - ?. ft th 2 ft fc ffi IB 'P ft < t t lOOg^fcttKtSXf 77"i s 
ffi IB IS X 7 >y 7* ic S tJ T ffi 12 7 - * ^ - X <£ ffi IB 'p ft < t fc 1 o co g It B if 7 § X 
f77"t, ?r S tc €? x tt * m 2 2 IB m <D 73 ffi o 
C I S * 55 6 2 ] 

ffi IB tt $5 X 7 -y 7° £7 I^§a-f-A^©f |J^fi(f£Otli%ttS fcfiJStfefe, 
ffi IB S «r X 7 y 7° *^ ff 2 ft 5 , If * 51 6 2 IB iS cd 73 ffi . 
[ IS * 51 6 4 ] 

ffi IB H St X 7 -y 7 7b s ffi IB 7 - * ^ - X {S # f * < S ft § rt - if' - 6 co § ^ £ ffi * ^ t> 50 
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& % . m * m 6 2 ic e m <d fj m „ 

[ « * « 6 5 ] 

^ - if - m * © m # « # ? n re * ii &j is -?s m -r & m n £\ i> & < tt, 1 o«7 a< 3 u x 
a £ 0 » * n /c s * v m ib * is is ^ © '> & < tt loogp^A^ttai-r^atti 

m ib » m ^ - y Mcsi^nifc^ m ib * » su m % e. « m « n ^ it n <o '> & < 

» , S«P&*©^fS-rsiSIB*^'tf»giJ-r-^^-X%fflv^T, M IB * IS B'J S g © ft & 

* H »J * f? * 5 k i: t> fc: > *u IB '> & < i: 1 o © 7 ;l/ dT U X A \c & ^S^tifcgttl 

* ^ t> s n rc ttf IB m $ © '> & < t & - m <d & * ic a ^ < m ib m & » is gy # , m - © a m m 10 
w * * * © fr ju s t? is bu Lrcm&icm m * is ay m * m m r z m m ^ - y h t % * ^ t? -> 

[ M rft 6 6 ] 

HSC7/l'a'yXi,*ffl^t*lSiJSfO'>fi;< & l"OOgp«-^5«»ogi|iS:*fflHi-r 

m ib m m ^ - -y h ^ & ^ s n t fc o , m is * is su m § e. m m £ ft re '> # < tuocg 

t 3 V IS 1 lc *f tS L T £ Sic £ ft fc £ tt % tt t? '> * < tfe 1 Oflr-M-X^ffl^t 

Hu ib * is m m % <o m & & m m % n ^ ^ 1 1 1» tc , § e » t s ^ < m m m ii * ^ gij ^ ^ - cd 

S * ii « * g ^ © ffi ffl JS T- » S>J L Tc * ^ tc tu 5B * it S * IS S'J "T 5 IS 8>J ^ - -y h i: , * 20 
^- ty x t- A o 

C W * JS 6 7 ] 

xmmmm z mwi* % n. & k m ^ 5 ft 5 -r - ^ ^ - x k ^ nrcmmm n% mm? % > 

X r- A T o T . 

3-^-m*cO®^*ligiJt-5rcfe©HusBv ? -^^-X©HulB^--^-^Rfr*-r§«^{c 
M»#it?.ftfc^^^f ? -^?rlR»-r5S«rL->y h , 

lu IB »S * © * < ioos»^5'>4< kfe loofgt^imt5|[iia-7 h t, 
MIESIar 7 hi5j;tfiIEaffiaz7 Mcgl^ntfcD, W IB f» - ^ ^ - X T M IB 
*K»f f -*fc»-r*^*36i«*mSftfcli^, M IB ii W O M S'J 1» « fc L T tu IB 'P % < 

1 -o<D^$H.*.U : &lr siBtiai. - <y h £ , ^#cy>- XT" A, 30 

C 58 to P US * S£ 0J? ] 

[ & ffi «■ HP ] 

[ 0 0 01] 

*awt43>-ri"y3!»»6«e/»H*iitSij-rsc: i: , ic =g i&mm t / mm m t % 
: t<DM<DmmttMfr'&t>-&T, ^ 46 it m t, * ^ * gu 7? s * m ^ * e ^ e fc is c t «fc t> 

« $t a 73 ^ a *a T v> < c k «k »J3«giJO<3J(S14*|qJ±*Hi-Te«ltt©WV'>«B'J*ja*W 
[0002] 

§ ^ ( *s <t t: t* ^ ) ss/SH©»sijfc:t±*ja©fflj^^*s. ^<©fflia, as w / s 40 

2 1 1H)ieo*346tu^ltTffl%$ft^T'yyx^-^©7ri';l/«Wy7 h-7iT-^ 
; eoft!iraHicD-9--extc < i:0, c olo->xfA*iPJffltS c fcolSttii'i Lft. m fit 

* IS g'J «r ff 5 C t lc H t S - - X t± ^ * iff A> o fc *^ ifco^X-rAtCO^-XfcJES^. 

[ 0 0 0 3 ] 

8 5 / S H IS BU © SU © ffl ii ti , fiS g % H < ( * t± S iS * ft S ) 18 s a-f-tML« 

tall^lfttSutffes. - 09 # * y 7 * 7i/ 7 m >% - t v-wv-t, ; - ( 

Gracenote, Inc. Berkeley, California)*' 1 ?)tt^S'ft 

r ^ 5 c d d b m ft is m -9- - tr x -e £ o , a y v x> x ^ ( c d ) % » su l t , is su 50 
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s n rc c d a: m t z> if $fi , fmf7*/u« 1 r - x ^ x h , h 5 -y * * * *j <fc zf -c > * 

-*>y Mff)ia3>r>7 ( 7 7l> A A * — > 7-f-fXhfeitf77>O l )i7'f^ 
h a| ) /\O7^-bX5:aftt« 0 CDDBf-t*X(iay;^hfVX^I;Igi|t§i:i: 
tlLTli lfSi)Tfe§t©0> C D ^ D V D 3? £0 U A - ^ "7 ^ x -f X ^ tc U U £ n T V & 
^7 7-T;l/«l 8U ffl 3 *i fc t± v < o o m tf\ 1$ & 5 „ 
C % W cO M w ] 

[ fP! ft? fei L * 5 ttSII] 
[ 0 0 0 4 ] 

j! % 31 o T it gU f 3 ® fJt 3 o fc /£ - o © b H[ g i t ft S L T i/ 1 § PI ^ f jSEIIL 10 
[ 0 0 0 5 ] 

yi/-x;-^lCDDB->^fi»ii, secf f77^;^mp 3f oioy^-? 

-y h 'N x 'J Z )\> W K ^ ^ ft f 5 T 7 7" U X - -> a > tc f£ ffl s n 3 C i: t- W £ T? & 5 0 c n 5 
0}5§ft77 , ;y-i'3 y«^U-X7 - M± <D C D D Bt-t'X^fiJffl Lt, ftmt<D 
ft M £ Z n n y 7 h x -c x 7 % Hi gij l , # h ;l/ *s * 0= I D^^eiEUii^^f-^ 
« £ jA t? „ yi/-Xy-htOCDDB^-lfX(i, # h 7 7 ^ IC W LT-i% I D ( 
TU I D) ^IL, CClOI D%MP 3 77'('A II] C I D 3 V 2 ?^(CSAt5. TU 
I D « /n -y a ft * o «l f'J fil » £ ft T *> 9 , U - X / - M± M ~> X x A V <D H K * 
jA * bJ fig -p 25 5 o LAai D3 V2^yii(S#t:i*t«ti:ib'T't, $S77^*OT 20 
U I D%glJ«77^;l'0 I D 3 V 2 ^yiCfittSil ~> T , T U I D 

* & t? » 7 r -f /l/ co g ^ n > x > y tc *f L t ft ffi ft to ffi v IK 8U x £ tt v» *. * v . 

[ 0 0 0 6 ] 

yi/-X/-httSC DDB->Xfi>li$fe, ^7^7> FSIKJ: Oiffi^n/if + X 
tc ftL — mtkm? 5 z tfc £ *) * 7 7 << to £ > 771';1/-/U > I D^' I 

fc ^ m t> ]$ # t *ij ffl r § *^ gf A'3y/<n •f-fx^^DisftT, -r n 

fr®7*-?7 H'7 7-f;HcS#2nTLI5i:, liOf ?nyf >7 tf htf 30 

&at« c t % m 46 § 73 a « m fro a 

[ M Ml « ft -T S fc 46 £0 # IS ] 
[ 0 0 0 7 ] 

* % B£ co - Sg m V It , UV-XOffiffl«r«'>PBtcaJ^.oo, @ g <o M SU fig 73 * « 7^1 f t T § 

0 

[ 0 0 0 8 ] 

* 5g BJ? CD m O KB « T* B > « % CD m 8>J 7? jS % ffl W f pfUl^O'J V-X ; &^< IStSS 
(± S ^ *l <0 * tc ffl v 5 J: 5 tc f 5 „ 

[ 0 0 0 9 ] 

* % Bj? CD JB ft 5 fit "P B , * IS 9J 7* - * CD JQ. If £ S '> PS (C *p A 5 . 40 
[00 1 0 ] 

* fg w <d m <o m m t? « > m a cd ft « a tc a -r s s t? , « & * fa a w jm s w k , » ^ tc 

«t 0 A fffi ^ 18 BU S W * ta L T ffl v 5 o 
[001 l ] 

*«w©*feH*aiB«'^«. * » BU s b fr m a # it 5 n rc r- * x h t , w gu m * » ^ k 
n ai ft if % n fc x * x hsjtats: t tc * o, n > -r y ^ at -5 < s m co bu # m •? 

[0012] 

* ^ W <0 * 7c S tc JW cd B m T « * ft W 14 * fp] ± 5 § ^ < , S a § a M fr 6 <0 it S Ifi 9J 7a 

& * f'J ffl f <s o 50 
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[0013] 

# % m CD ft ft 3E ft § H « t? » , 7 r 5? - • h77^5»«fSffl^T, 3>r^lc|tJ< 
[0014] 

* m W © M f<: BU © * T* 14 , Slf-^^-^tfflv^n?, « s £r M BU ffl © tt 9J - * 

% g id w tc m m -r § . 

[0015] 

# % M © ft ft M ft 3 M 14 , *^igiJii«^JaWWtc->X-rA-\SSAbT, « ifi il fin £ 

n fc x - * i= tt « & & & s ft rc & ffi (c <t o hr bu pi fli ^ s ^ % w ^ * « . 

[0016] 10 

± as co mi «t ix -jk © «t 9 ft is e is bu 73 ffi tc «t t> m m *i m u & % . pj 73 a t* , 3- - -f - p/f * ® 

«E#fc«#Stife*il9J**K:HI"r*1ll«fc, 3R*a*9J »*©'>*< fc *> 1 o © ff # 
e, '> ft < k fe loOT^J'JXAlciOftS^nf^in^fflffltSXT'yy^ a & * N 

^-XJ&ffl^T^K^iRg'JS^oSii^aKg'J^ffft^X-ry^, ft X XS S ^tf © '> ft < 

k«,-au©4s4rkr ;i/ druxAWfcst^sn t t. 1 o © s tt * ffl * £■ t» ^ ft t © 
tcscJ<MiSMa*»BU35)^*-©s^sae*-fn€n©ffifflS"e»gij , rsJi^JcSK*» 

bu s % is 5. u f s x r -v 7 tc «fc 5 o ^ & * as su » « © '> ft < £ *» i ^ « # « > £ ^ 

[0017] 20 

^ _ ^ ^ _ x u # jg {c a N §g gij -9- _ e x • ~f p / w ^ © ft] » t tc $> %> y - - n if w m m 

14, -B.»9J£ftfc»^fcM«ttl7 5ft4.> i^t, -MBU? £ffl ^TM©M^lt 
BU 2 ft T , i& m 3S & W & to T ift iS ft 5 o — *C Wi BU ^ 14 ^ -f */ a y W IC , i« ii R A M £ fc 
« BU K: ^ *i I It ft fc 7*— * ^ - ^ • f-7 , ;H: + i"V->aJti5. 

[ooi8: 

* m m is « tc it m m ? - * m m ? is ft ^ m & , sK*i»JSf b. isoj^i'JXi, 

^fflv^T^^o*igBlJS^© / >ft< kfc io©g&#fr?.«SS::&ttai-r£Xx-y7£:> ^K* 
ty>ft< l oof-M-XiW 1 !, SIS*iSgiJS^©l,jA^ilig | J ; &tTft^7.7- 30 

[oo i 9 ;i 

» m t4 , - *f - F/f W © ii ^ © IK 53iJ tc ffl ^5 ft . « *S[ W IS £ # S ft V> gt # © 7 s - * ^ - 

x f 7 t' t , ii # © ^ ft < k l -o © 7j ft* e> '> ft < ife i oogK^ltiltSXf 

k x ^-^.^-xJCT^^mr f -^i:^g(-r57 ? -^A^tIl?ftfc«^^^^'>ft< fcl 

oL_-»f-j^^«3D^-7 :f '<'^-c d frz 7 s v ^ 7i/ sfc * -7 r >r 7i/ * ft ^ it t % 5a s © ia m »j 
ffltti^ftfcgs^^-^^^-c d jg s m m # it s c ttftts, 

[ 0 0 2 01 

© ^ S « - « IS BU ^ © v> -f ft * ffl ^ % f» « © iffi BU , » ® ii M BU ffl "r - * ^ - X tc 
«#£ftT^£!t!!©1i$8> 09 * 14 » b © * 5 ^ » « 95 tc a to $ ft % {f §$ gij ? ^ i 

t, © © £ t ic (4 & l ft ^ is # tc m t z m n a , o © m h is t? ft m t ^ < is # r s c 

t tfi T # 5 , ± 5zH © J; o K § JR *M# 5 ft « # , SROHIieKD itt* 1 ** 
o Ia£ -3 T x t -y t 4 - > ^ * ft ffl tc IS # Z ft T v>5 1R $8 © ^ * - V M BU tc S -3 ^ T , m V * * 
^U-5!|c!tLTffi*t5C fcfc, $,i,V^^4f : '-^^-7(c^S#^ftT^/^§«fR^->X7- 
i»«««fiE^*Cfct,7f** 0 WI A tf x ^^ROdStftfttS'fiS^nT^Tt, * ft « 50 
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n © « £g ti -- fi L T ^ n 5> tc £r & L ft ^ * ilr tc f± , tttf-i"<-XOK!) 

k m %a -r & *:> s ft % % ft fe l n ^ i\ 

[ 0 0 2 1 ] 

* ^ sfl a N -l - if - m w co & f* tc « # s n & * m m » & ic ra t % w ?a t 'p ft < 1 1 1 

7;l/3'JX2> ICJ; <3 ^ ^ £ tx ft « UK * , ^K*WSUS*<o^*< t 1 oofflJ^^SfflUi 
h i:, % mttl tU 3l - v Y- Ktetit* tir *s 0 . S^*ISB'Jti^fre>ftll±i£ft 

K * IS BU Si If © M 5A * iS gij * ft & i v S^f «0'>ft< i: - SB © £ * T )\> =t U X A ft 
tc ^ £ ft ft '> ft < t 1 o CD ^ & i: © ffl * fc> •£ tc S "5 < S W. M & 2* M S'J > f-Ol 
ip»«**<'©«fflKTK9Jbfe»^fcaK*i«B'J»**ii»J - r*«9J3.-->' h * 3 tr » io 
f'f ,1 8>J ~> X r A * it ts o 
[ 0 0 2 2 ] 

*f BKiSfc, fcROT/l/rJUXAfcffl^TTfcWBiJ »«©'>£< t lool»fr5SS 
*itUt«Ji6llia=7 ht, M M to ^ - -y Mc ^ ^ £ ft T & D , 3 f£ * i® B'J §i ^ e> » 
UJ 5 ft ft '> ft < H 20©^$#£S^Si«tCttJSLT£j££ftft^»© / >ft< t t> 1 O © 
^-^^-XfcJfcffll^T, S 8 * » 53U S ^ © II & # » B'J * *T ft «««»C»^<SKM 
& * M BU , *-0»if!S§*=&'<rOMfflat?»giJUfe»-&{<:aK*i«giJ»«*»SiJ-rs 
M BU ^. - >y 1- £ Pr tr Si f'f M BU i/ X -f A ^ ty . 

[ 0 0 2 3 ] 

± j$ CD i/ X 7- A CD ^ ■? ft tc ts V< T , Mil^, -f > $ - * V h m © * <y h "7 20 

- ^ «r /M, T » SU 3. n >y htLTC>4< i: t 1 oo^- — fcjgMSftft^^'l'Tyh 
IfffcS. ^7^7> f81!i, Si It tc 7 ^ ^ X T 3 F ^ ^ 7 ^ if * ft ^ - V ^ ^ • 3 
y If a - * , ^yF7-^l*tt5lil D a p, * £ * IB 53U S # * & * J§ m 6 »J © 
±1 F/f 's 5M fS T 5 -9" - — • ^ytfa-^tJ&^TJ;!/^ 2 5 tc , f* - £ ^ - X © — SMi n 

- * >v ic m m Ri m x* & o t , tt ttj ^. - -v h ^ <t ir bu a - y h * s i-o«iKEisnT 

[ 0 0 2 4 ] 

* 5g 0^ fi S tz . * I® B'J Si § % IK B'J T 5 fc «> (c ffl ^ 6 ft § =r - % ^ - x « # $ ft S * ffi 

m % mm ? <> ~> r- * -s; ts o a ~> x t- a « , ^.-■y i '-Fjf*©4s^^iaiBij-r§^i6©T : ' 

•y hi:, Si If <D '> ft < i: *, 1 o © gp ft ft 5 '> ft < t 1 ocf S^itUT^Iffla^'y h 
t , fW ^ fit ^ - >y h *5 <fc (W IH te m J- - y h tc S ^ ^ ft T ts K> , ^-^-^-XrtT * 

»7 ? -*k:«"r*^»3V*a«ftfc«^fc»«©«siJiii«i:bT / >a< 1 o © s * 
fii # -r s ib n ^ - y h * # ty o 

[ 0 0 2 5 ] 

£ ft 5 J: tf §1 * Ml § M ^ 5 ft « ftfi © ffi « ^ f"J t± s * HO » *5 <£ U' W * IB IS f § l¥ 
Hll ft « file *J J: id ft ic & * ft T *s 0 , *W«iO-«P*St*f<tHl«#igt5*', * © 
111 - ffi *t f«: (± IH - S ^ *^ # # £ ft T V> 5 0 

[ a w % 5i #i f * fc J6 © a a © m m ] 

[ 0 0 2 6 ] 40 

* 58 0J3 i ft fc£ , [SI l ic ^ ^ ft 5 «fc o ft X r- A (c v> T IS BU tc m •? % & B ft -b y h fc 
fioTHV^-^yhOi^Sf^n, « StC © 73 ffi f J ffl L T £ ?S ( 43 «fe Xf V =? * ) ~7 T 

f-^^t?ff-^^-X9 0 £ t* '>* * 71/ W ^ * f- ^ X h tf tc m -5 % W. 8>J f § 73 ffi i: 

u:*ffli/''Tff^'&i«gu-r«*jS4:!ia*'&fe*So » ss k « , ^-^^-x9ort©T-^x 

h • f 5 ' - ? l;t a - If - J; D ^ ^ 5> ft , 3- - if - ^ 5 A 73 £ ft ft X ^ V y 7 © ^ U x - -> 
a ^ * # A, -(? ^ o f Oi^ftf-M-XO-jHT, yU-XZ-httOCDDB 

MHffltf-ex « ffl ift -e * * o 

[ 0 0 2 7 ] 

El 1 tc ?S -T J: 9 , Si ^ 1 0 O li, a - KfV X ^ S fcti 3 y;^ h f ^ X f 50 
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fo^js y r -< >v*n&&tsm<D&&e>i£%iJ3miic <t t> * ? * r > vm.m 1 1 o*57n 
x^n^o it i o o jb-j;tff«t5ii c ^ 9 f - ? ) ft^ist ^am^tis 

„ «TfcJfat«J;5lC, ill 00*<5«im*n5i«tt«ttT*8. ^ * -r - * * s 
t±J $ n ft ir, $B It . CD h 7 x y ^ © (T0Cfr5fl5n5) ^'y^fefS^aOSI 
b# n , Si S * • M p 3 y r ■< >i & Z> m & ii 7 r << >l % *j cfc XS i D 3 * ?\ feitfSf tfC 
D±i:$5*^iil* (TOO x - * £ # t? o Sf *tA,i?^87r^;Vtf*»ffiKffi 

oT»ff-r«^^^7>ha«{cj;03i^5nfctf^, i d 37r^;^e-i4 i d*' 

l^nK ic ft § , SI «J tt * © W $fi f'J ffl T? # * ^ t © <5 ^ T 5 o 

[ 0 0 2 8 ] 

- m m m m <r> m k *> ^ x , » a ? n ft m tt <7 ^ ^ r > h 1 1 o *» e> - ^ - 1 2 0 ^ g 

tifcili^ttsr-^^-X 1 3 0 £ m v T * t$ 8U £i b © It 5& » 1$ B'J * fr ft 3 0 7- * X b 

««ifttt-ifti d (is i d ) # a fcb s nn fcf , — atftsRatfrfcti*- ^ * x mm 
$ ft » - at ft i Dii^T«« | i)iiiisnfti&, '> ft < t fe loor^i'JXitit) 
i*s?nf;iittf, si fa s k a * n 5 * tt t tt « $ n r , it 1 oofrSiffl^nftffi 

tf^stsfrg^sfiists. y + xmnititf-iai d k a -3 ^ ft & # * u x* t 

m fc tt 8>J -e * s ^ # * e> n s . n^o^s^ffl^tf-©if if ^tfs?n/cs 
, »Iictel»ftlxf7ytLtgf l ooo*#WFlHI*«#-©JI*P»*oW*i«ia 
i: it « * ft ^> = 

[ 0 0 2 9 ] 

» a it , no a * * t* - * * ffl ^ t w tt m su k «t ^ t# 5 ft ft * * be f a . * e «> § w 

S-TSn*U)5„ h 5* -y ^ fi © l± M k: £ o T M ^ ^ C k ^ <£ D , ->XrAtfi4« 
ft I® D £ K L , *(DK0KttlEfflO77y4i[TTfe< £ k nj fig E ft 3 <■ 
[ 0 0 3 0 ] 

* % iH E «fc S *s X 7" A It iff m tc tt , *a©l«8iJ7?}*43<J:tf*0«H*OS*«*J*^*»= 
tS, agtt*0*S»*ftffl45J:tf*«ca:«affl^>*-7x-^l 3 0^#t? 0 

as gu 73 s m k $ m bk «j * * » *f t % c a * d > sa#«K8UBS**«^<t-r^< ; &«fi8 
s * <d m bu js * * ^ § c t & t* % z> o *aweJ;Sf xfAttffittt* « as ^ * ( 1 

4 0) £ ffl -T ^ < , yu-xy-HiCf-H-fX3P5*frLTCDDBf-H 

- X * fU ffl L T ^ § 2 8 0 0 7JAtt±O3.-1f-(C i5iif-^ 
[ 0 0 3 1 ] 

§ii(;f3Lt^T^§o «XS, Xb'J-5>yf^^ISt577'J7-i'3>(i 
^ 7 . > y ._ . k « 7 . , y x f - A <d y r -1 >l * MW\ T %> © * 7 7" a y A 7J * 8» 3'J 1" § t> © 

fiS « H SU "? Z Z> <fc 3 K » fiK -T ^ C fcA'ftS. 
[ 0 0 3 2 ] 

m. © m s>j 7a ?s * ?u ffl l t , ^ « tt ss © u v - x £ < ffi ft r § 73 s « ^ s ft t * © * k. 

ffl v * . « R © * * * tt S fif * SRI ffl -T * c k J; K> > r-*3 | ;s'a>« , «!)< H # © f 
^«ttS*©fe?»^5 rw^j ft^M-?n5o *-of«affi*^Jfflt«t«'>XTA 

ft , m s © /s ^ k m rs © vk m s * w ^ t r a . 
[0033: 



(12) 



JP 2004-537760 A 2004. 12. 16 



[ 0 0 3 4 ] 

B2K*tJ:5lc. * » S'J ( * 50 O ) »« 1 0 0i'S«%tttlit5f 7^7^81 1 1 
0*^7^feX?nfci^, BJ &6 fc 5 fc? SB BU X x A 2 1 0ia^*OT0C/7r^ 
;b ,1 B'J ^ £ :; f 2 ft T , gS 2 2 0tfH^7VHill 1 0 fc £ IE ft Z> . TUIDtfM 
3 ft fc * ^ IS H 2 2 0 fc it > ~? X ? - • * * f 2 ' - * • f - 9 * - ^ ( H 2 fc 75 * "f) © 

rt«^©ii?Y>?fca*-*«»J? (tuid) A'tsns. mm i o o u * fc > '> * < 
tuo, s? a K a « » o , fnfn7;^uxitfS45f«s;iaji'XrA*ffl^tf 
a m m 2 3 o fc * r> x m a s n , t«k/iDafl*tyfa 2 4 0 KSSsn5. «t 

fc # 5ZE -T S <fc 5 fc , »ttTy:/n-*-250tf*tt*^oStt«»J'*-->*--l 2 0 ^ £ 
m f ^ § fc 158 « » * # S ft £ ft S . 
[ 0 0 3 5 ] 

S tt K 9J tf - '< - 1 2 0 fc ^ T , If JR 7 V -f u - 2" - 2 5 0 fc «fc <0 x£ fe 2 ft * tt tt * 
fttt«l*fffa 2 6 0 K«SSn5. * ^ TJ * ft fcfc , il©i«fcS45i>F 

« ■& fc & SE JbMf ft § o « BE « ± a B W <D # ffi fc «fc o T fc fi 3 d k * 5 . ± i 2 * ffi 
it ^ a 7* - 9 <r> mm fc © ±l o ■/ a -b x o - fl? ij T* & 5 o 

5 . w * tf . ^«*<***3o»KK«i-3fcii»©KiB**5«i6nT^«»^, « tt «: a 

IWSsiitx h y — A fc in I £ ft 5 o c ft fc «fc D . « « K n © M 9J # * *6 * * * • ^ * 
(ft fc ft 6 ft fc li&ti > K#f-M-X90 (01) lcII#(^nftg«f-^-x 

2 9 0 fc ft # £ ft £ o 
[ 0 0 3 7 ] 

0 2 ¥ Bf JS fc f± 1 2 0 0 Sh7 7^*itf9 0 0, 0 0 0 7;W<A%8iJ J< >T- 

# . ^^^^-x^if ?nti/^o dcDx-^^-xii, a # * * x* - * ( t - f- f x 

fettf fcffilf-^ v-O^) © Pi # £ ^ tf 

■»f — fc <t; DssjtisSa i o o fc n s «■ it b ft fc # m x - * * ® m l , a « © '> a < 

i:t,ioo*#4»6f»*«iaiT5ffla7;l'd'JXi**fTt«. * ^ t? b tt U s & ® fc 
(iCDOTOCA^»5n5J:^-ISI DtftlCt-^-l 2 0'\aMfa$ft§ o — * 

ft fc * ^ — 1 2 0(if-^^-X9 0 <DmW% * 9 t 1 ' - 9 t . a-f -RlfWOS 
^^HiBlJ1-?»fc46fc^#e»ftfc^^^>7 ; •-^^-X90^fflV^TCD^i^SlJ-r§^Di:^l- 
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TITLE OF THE INVENTION 

MULTIPLE STEP IDENTIFICATION OF RECORDINGS 

CROSS-REFERENCE TO RELATED APPLICATION(S) 

[00(M] This applica ion is related to and claims priority to U.S. provisional application entitled 
DIGITAL MUSIC MULTIPLE STEP IDENTIFICATION METHOD AND SYSTEM having serial 
number 60/308,594 , by Dale T. Roberts, et al. , filed July 31 . 2001 . and incorporated by 
reference herein. 

BACKGROUND OF THE INVENTION 

1 . Field of tie Invention 

[0002] The presenl invention Is directed to recognition of recordings from their content, and, 
more particularly to combining fingerprint recognition with other information about a recording to 
increase reliability of recognition and to accomplish reliable recognition efficiently by using the 
least expensive fonns of recognition first and layering on more complex fonns as needed. 

2. Description of the Related Art 

[0003] There are many uses for recognition of audio (and video) recordings. Many of the uses 
relate to compensation or control by the rights holders for reproduction and performance erf the 
works recorded. 1 his usa ot such systems has increased in importance since the development 
of file sharing soft* are, such as Napster, and the many other similar services available at the 
end of the twentieth century and the beginning of the twenty first century. Although the need for 
accurate recognition has been significant for several years, no system has been successful in 
meeting this need. 

[0004] Another use. of recording recognition Is to provide added value to users when listening 
(or watching) recor Jings. One example is the CDDB Music Recognition Service from 
Gracenote, Inc. of Berkeley, California which recognizes compact discs (CDs) and supplies 
information regarding a recognized CD, such as album name, artist, track names and access to 
related content on he Internet including album covers, artist and fan websites, etc. While the 
CDDB service is effective for recognizing compact discs, there are several draw backs in using 
it to recognize files that are not stored on a removable disc, such as CD or DVD. 
[0005] Al! audio fingerprinting techniques have "blind spots", places where a system using that 
technique sees similarities and differences In audio where it shouldn't. By relying on just one 
fingerprinting techi ique, single source solutions are less accurate when encountering a 'blind 
spot*. 
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[0006] One -if the more popular uses for the Gracenote CDDB system is in applications that 
digitally enct<Je audio files Into MP3 and other formats. These encoding applications utilize 
Grace note's CDDB service to recognize the compact disc being encoded and to write the cor- 
rect metadata into the title and ID tags. Gracenote's CDDB service returns a unique ID (TUID) 
for each trac* and supports the insertion of such IDs in the ID3V2 tags for MP3 flies. The TUID 
Is both hash** and proprietary, and can only be read by the Gracenote system. However, the 
ID3V2 tags can easily be manipulated to store a TUID for one file in the (D3V2 tag for another 
file and therefore, the TUID alone Is not a reliable identifier of the audio content in a file. 

[0007] Grac jnote's CDDB service also provides text matching capability that can be utilized to 
identify digital audio files from their file names, file paths, ID tags (titles), etc. by matching the 
text extracted by a client device to a metadata database of track, artist, and album names. 
Although thi£. text matching utilizes user-generated spslling variants associated with each record 
to Improve re icognltion, there has been no way to verify that the text matches the audio content 
of the recording once the recording has been separated from a compact disc and stored in a fiio 
in any forma . 

SUMMARY OF THE INVENTION 

[0008] An afpect of the present invention is maximizing Identification of recordings while 
minimizing resource usage. 

[0009] Anotf ter aspect of the present invention is using multiple Identification methods so that 
resource inte nsive methods, such as audio fingerprinting, are employed onty when necessary. 
[0010] A further aspect of the Invention is minimization of processing of unidentified data. 
[0011] Yet another aspect of the present invention is to use the least expensive recognition 
technique, w th progressively more expensive recognition techniques layered onto the process 
until a desired confidence levei is reached. 

[0012] A still further aspect of the invention is validation of content-based identification of a 
recording by comparing text associated with an unidentified recording and text associated with 
identification records. 

[0013] Yet another aspect of the present invention is use of recording identification methods 
from differem sources to increase reliability. 

[0014] A still further aspect of the invention is validation of content-based recording identifica- 
tion using fiJ2zy track length analysis. 
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[0015] Yet aiother aspect of the invention is automatic extraction of Identification data for use in 
a reference database and for Identification of recordings. 

[0016] A sill further aspect of the invention Is that unidentified recordings are periodicaliy re-run 
through the system to determine if recently added data or recently improved techniques will 
result in reccgnition. 

10017] The ;»bove aspects can be attained by a method of Identifying recordings by extracting 
information .ibout an unknown recording stored in media possessed by a user and at least one 
algorithmica ly determined fingerprint from at least one portion of the unknown recording; 
determining a possible identification of the unknown recording using at least one piece of the 
information extracted from the unknown recording and an identification database of 
corresponding information for reference recordings; and identifying the unknown recording when 
the possible identification based on each of the at least one piece of the Information 'm 
combination with the at least one algorithmically determined fingerprint identifies a single 
reference re »rding with respective confidence levels. The at least one portion of the unknown 
recording may contain audio, video or both. 

[0018] Preferably, the database is maintained by a provider of Identification services which 
supplies unique identifiers that can be recognized only by servers under the control of the 
provider of identification services. The unique identifiers are associated with recordings once 
they have been identified. Subsequently, copies of the recordings are recognized using the 
unique ident tiers to greatly speed up the process. The unique identifiers optionally are cached 
in high-spee i RAM or specialty Indexed database tables. 

[0019] When non-waveform data is not available for an unknown recording, the unknown 
recording is areferably Identified by extracting fingerprints from at least one portion of the 
unknown recording using a plurality of algorithms; determining a possible identification of the 
unknown recording using at least two of the fingerprints extracted from the unknown recording 
and at least - we database of correspondingly generated fingerprints for reference recordings; 
and identifying the unknown recording when the possible Identification based on each of the 
fingerprints Identifies a single reference recording with respective confidence levels. 

[0020] Preferably, an existing database, used to identify recordings possessed by users, which 
does not cor tain fingerprint information is expanded by obtaining non-waveform data associated 
with a recording possessed by a user of the database; extracting at least one fingerprint from at 
least one poi tion of the recording; and storing the at least one fingerprint as identifying 
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information forth a recording, when a match Is found in the database for the non-waveform data. 
One example is that during the process of encoding digital music files from an audio CD 
possessed by a user, a recognition system can be used to identify the audio CD so that 
fingerprints extra rted during the encoding process can be directly associated with the audio CD 
using a unique Id system. 

[0021] Recogniti an of recordings using either fingerprints or unique identifiers is preferably 
validated by other information maintained in the identification database, such as the length of 
the recording or n numeric Identifier embedded within the recording. Information about 
recordings lhat d 3 not pass validation or match some, but not all of the information used for 
Identification, may be stored for later analysis of the reason for the error. If the fingerprints are 
obtained as described above, there may have been an error in obtaining the fingerprint. 
Therefore, errors may be output to an operator, or the system could correct the information 
stored in Ihe database, based on recognition of patterns in the Information that is stored for 
improper matches. For example, if a large percentage of matching fingerprints are stored, but 
the other informstion consistently does not match them, there could be an error in the fingerprint 
database which needs to be flagged to an operator. 

[0022] The presunt Invention Includes a system for Identifying recordings that includes an 
extraction unit to extract Information about an unknown recording stored in media possessed by 
a user and at least one algorlthmically determined fingerprint from at least one portion of the 
unknown recording; and an Identification unit, coupled to the extraction unit, to make a possible 
identification of the unknown recording using at least one piece of the information extracted from 
the unknown receding and an identification database of corresponding information for 
reference record ngs, and to identify the unknown recording when the possible identification 
based on each of the at least one piece of the information in combination with the at least one 
algorithmically determined fingerprint identifies a single reference recording with respective 
confidence level: i. 

[0023] The present invention also includes a system for Identifying recordings that includes an 
extraction unit to extract fingerprints from at least one portion of an unknown recording using a 
plurality of algori runs, and an identification unit, coupled to said extraction unit, to make a pos- 
sible identification of the unknown recording using at least two of the fingerprints extracted from 
the unknown recording and at least one database of correspondingly generated fingerprints for 
reference record ngs, and to identify the unknown recording when the possible Identification 



4 



JP 2004-537760 A 2004. 12. 16 



WO 0:/0126<* PCT/US02/24054 

based on each of the fingerprints identifies a single reference recording with respective 
confidence levels. 

[0024] In either of the systems described above, the extraction unit is typically a client unit 
connected by a network, such as the Internet, to at least one server as the identification unit 
The client dev ce may be a personal computer with a drive accessing the recording, a consumer 
electronics device with a network connection, or a server computer transmitting the unknown 
recording fron one location to another. Furthermore, a portion of the database may be 
available locally and the extraction unit and identification unit may reside in the same device and 
share components. 

[0025] The pr jsent invention also includes a system for obtaining reference Information stored 
in a database used to identify unknown recordings, including a receiving unit to obtain non- 
waveform data associated with a recording possessed by a user of the database for 
identification c f recordings possessed by the user; an extraction unit to extract at least one 
fingerprint fron at least one portion of the recording; and a storage unit, coupled to said 
receiving unit and said extraction unit, to store the at least one fingerprint as identifying 
information for the recording, when a match is found in the database for the non-waveform data. 

[0026] These together with other aspects and advantages which will be subsequently apparent, 
reside in the details of construction and operation as more fully hereinafter described and 
claimed, reference being had to the accompanying drawings forming a part hereof, wherein like 
numerals refe ' to like parts throughout. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a functional block diagram of a system according to the present invention. 
Figure 2 Is flowchart of a fingerprint extraction according to the present invention. 
Figure 3 Is a flowchart of a method of recognizing unknown recordings. 
Figures 4A-4C are a block diagram of a system according to the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0027] According to the present invention, a suite of Identification components are provided in a 
system like that illustrated In Fig. 1 to facilitate analysis and identification of audio (and video) 
files utilizing multiple methods. Preferably, an existing database 90 containing recording 
Identifiers anc text data is combined with text-based digital audio and audio fingerprinting 
Identification methods. Preferably, the text data in database 90 Is obtained from user 



(25) 



5 



(26) 



JP 2004-537760 A 2004.12.16 



WO 03 0 1 2695 PCT/US02/24054 

submissions and includes user-submitted spelling variants. One such database is available as 
the CDDB Music Recognition Service from Gracenote, Inc.. 

[Q028] As illus rated in Rg. 1 , a recording 100 Is accessed by client device 110 via any 
conventional method, such as reading a digital audio file from a hard drive or a compact disc. 
Information is oxtracted from recording 100 and associated information (metadata). Fingerprints 
are extracted fiom recording 100, as described In more detail below. The information that Is 
extracted from the metadata Includes the duration of the recording which is the track length 
(from the TOC; for a CD track, the filename and ID3 tag If the recording is in an MP3 file, and 
the table of contents (TOC) dala if the recording Is on a CD. If the file containing the recording 
was produced uy a client device operating according to the invention, a unique ID will be 
extracted from the IDS file, but Initially It will be assumed that information is not available. 

[0029] In an exemplary embodiment, the extracted Information is sent from client 110 to server 
120 to determine a possible identification of the unknown recording using at least one piece of 
the information extracted from recording 100 and a database 130 of correspondingly generated 
fingerprints for reference recordings. If text or a unique ID were extracted, an attempt Is made 
to find a match If a match is found using the text or unique ID, at least one algorithmically 
determined flncjerprint Is compared with the fingerprint(s) stored in the matching records to 
determine whe.her there is a single reference recording that matches the Information extracted 
from recording 100 with respective confidence levels for each item of Information that matches. 
If no matches can be found based on text and unique ID, an attempt is made to identify the a 
single referenc? recording using at least two of the fingerprints extracted from recording 1 00. If 
a single reference recording Is located using either method, preferably the duration or recording 
1 00 Is compart-d with the duration of the single reference recording as a final validation step. 

[0030] Preferably related metadata is used for validation of the match obtained by fingerprint 
recognition. Ll<e any recognition system fingerprinting can produce erroneous results. Without 
a validation component such an error can propagate throughout the system and return 
erroneous date to large percentages of users. The use of validation criteria such as track length 
comparison enables the system to catch potential errors and flag them for validation. 
[0031] A syste-n according to the present invention preferably includes custom result reporting 
and flexible administrative interfaces 130 to enable weighting of various Identification methods 
and the order c f their engagement. Analysis of successful match rates for specific identification 
methods allow;; an administrator to manipulate the identifying criteria for each component to 
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maximize the dentrflcatian probability. A system according to the present Invention preferably 
Incorporates isage data from over 28 million users utilizing Hie CDDB database via Gracenote 
Data Services division, to help guide results 140. 

[0032] The flexibility of a system according to the present Invention allows different 
configurations to be used for Identifying recordings in different environments. An application 
that monitors streaming audio, for example, requires a very different system and solution 
architecture If an one that identifies files in a peer-to-peer system, or one that identifies analog 
input. Howevnr the present invention can be configured for Identification of recordings In each 
of these situations. 

[0033] A system according to the present invention maximizes identification while minimizing 
resource usage. The use of multiple identification methods ensures that more resource 
Intensive methods, such as audio fingerprinting are employed only when necessary. The use of 
multiple audio fingerprinting technologies reduces data collision and covers any "Wind spots' in 
a given audio fingerprint technology. The "blind spots" found In single source fingerprinting 
systems, are avoided by using multiple sources for different fingerprinting techniques. This also 
provides the ability to fine tune deployment for specific target applications. 

[0034] Preferably, fingerprints are obtained using multiple fingerprint recognition services using 
the method illustrated in Fig. 2. This increases the ability of the system to accurately recognize 
recordings of various types. 

[0035] As illustrated in Fig. 2, when unidentified (unknown) recording 100 Is accessed by 
fingerprint extt action client 1 10. if possible conventional TOC/file recognition is performed by 
recognition sy item 210 and results 220 are returned to fingerprint client 1 10. Results 220 
Include a uniq je identifier (TUID) that points into a master metadata database (not shown in 
Fig. 2), if the 1 UID is found. Recording 100 is also processed by fingerprint extractor 230 using 
at least one and preferably several different algoritnmicalry derived fingerprint extraction 
systems to ob ain fingerprint(s) which are stored in fingerprint/ID send cache 240. As described 
below in more detail, instructions are received regarding when fingerprint uploader 250 should 
send the fingerprints to fingerprint recognition server 120. 

[0036] In fingerprint recognition server 120, the fingerprints transmitted by fingerprint uploader 
250 are initially stored in fingerprint receive cache 260. The fingerprints then undergo 
fingerprint valuation 270 using an algorithmic comparator that attempts to cross-correlate 
fingerprints for a recording with fingerprints uploaded and extracted by different end users. If it 



7 



(28) 



JP 2004-537760 A 2004.12.16 



WO 03/0 12695 PCT/USO 2/24 054 

is found that the Ingerprints are substantially similar, they would be validated. This Is not the 
only method that s available for validation, but serves as one example of a process that could be 
used to reject bad data. 

[0037] In this embodiment, fingerprints that are determined to be valid and related undergo 
stitching 280. Fcr example, if fingerprints are taken from 30 second segments of the recording, 
the fingerprints a* assembled Into a continuous fingerprint stream. This could simplify recog- 
nition of segmenis of the recording. The resulting fingerprints are stored In fingerprint database 
290 associated with existing database 90 (Ftg. 1). 

[0038] The CDD3 database has in part been generated through user submissions to create a 
metadata database with over 1 2 million tracks and 900,000 albums as of mld-2002. This 
database contains both basic metadata (artist, album, and track names) as well as extended 
data (genre, labe , etc.). 

[0039] A similar distributed collection method may be utilized in the creation of a waveform 
database using the system illustrated in Fig. 1. In the case where recording 100 is a raw audio 
waveform,' e.g., when a CD is encoded Into another format, such as an MP3 file, client device 
110 obtains non-waveform data associated with recording 100 which Is possessed by a user of 
database 90 and executes extraction algorithm^) to extract fingerprints from at least one 
portion of the recording. The fingerprints are then sent to server 120 with a unique ID, 
preferably derive* I from the TOC of the CD. When the unique ID is available, I.e., , when a 
match Is found in the database for the non-waveform data, server 1 20 is able to associate Uie 
appropriate metadata in database 90 and the fingerprint(s) with same level of accuracy as 
identification of CDs by the existing database 90 which is provided for Identification of 
recordings posse jsed by users. Fingerprints dynamically gathered in this manner may be sent 
to a fingerprint collection server (not shown in Fig. 1) which would accumulate fingerprints from 
authenticated clients, as described In more detail below, prior to storing the at least one 
fingerprint as ider tifying information for the recording. 

[0040] Multiple fingerprint gathering extractors can also be run over a set of static waveforms 
from a commercial encoder such as Loudeye or Muse. The challenge with this approach is 
associating the fingerprints with the appropriate metadata. The method described above 
enables audio fingerprints to be logically associated with parent records and associated back to 
the original audio source. In the preferred embodiment, the unique ID provides differentiation 
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between live and s tudio versions of the same song while simultaneously linking those records to 
trie same artist an J their respective albums. 

[0041] Preferably server(s) 120 store information in a parallel record set that are linked with 
unique IDs. Wher client 110 asks server 120 to recognize media (CD, digital audio file, video 
file) server 120 may also return a record about how fingerprints should be gathered for this 
particular CD. Thisjs caled tfje Gathering Instructions Record (GIR). The GIR may include a 
set of instructions that the remote fingerprint gathering code follows. The record may be pre- 
computed in off hours or may be dynamically computed at the time of recognition. 

[0042] Server 12C may use information It knows about the popularity of a CD to drive decisions 
about gathering. I everything about a rare CD could be gathered, because the opportunity to get 
the fingerprints would not want to be missed (even if It was somewhat burdensome to the user). 
The opposite situation could be true for a very popular CD. The load may be distributed across 
many users so th«it they would not even notice that any work for fingerprint gathering was 
occurring. 

[0043] The rules nnd procedures for building the GIR may be manual, automated and may 
change overtime, They may also be applied uniquely to specific users, applications or 
geographic locatkns, 

[0044] In one embodiment, the server dynamically gathers fingerprints by modifying the GIR to 
remove flngerprin's that have been gathered previously. The frequency of updating GIRs may 
vary from instant lo delays of days, weeks or months. Some example Instructions that may be 
included In the GIR are: 

• A list of track and segments to be gathered and their priority. 

• A fingerpri it generator algorithm to use. 

• Parameters that tell the fingerprint generator how to process the fingerprint, such as: 

Freque ncy of audio samples 

Bands of the frequency domain to process 

Resolution of the fingerprint 

Desire i Quality of Audio 

• When to d a the fingerprint gathering, such as 

Before encoding the track 

After e needing the track 

In pare Hal with encoding the track 
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• Instruc tions for caching the fingerprint and wrmn to transmit it back to the server, such as 

Before encoding the track 

After encoding the track 

After the CD has been fully encoded 

When the communication channel back to the server Is not busy 

When the next CD is looked up 

When a group of fingerprints is ready for transmission 

• Instruciions to take CPU power into the process so as to not overload the computer 
[0045] Preferably, the system attempts to Improve the quality of the fingerprints during 
operation. QtiaMy of the source signal, the parameters used for fingerprinting, along with 
improvements, in the fingerprinting algorithms will result in a complex quality matrix that is used 
by server 120 to determine what fingerprints to gather if higher quality Is available. An example 
of source quality is provided below: Preferably, database 90 or a simHar database maintained 
by fingerprint collection server(s) stores the source quality for fingerprints stored In the 
database, so hat when a fingerprint from higher quality source is available, the fingerprint may 
be replaced. 



Source Quality Table 



Name 


Bit Rate 


Compression 


Error Correction 


Quality Index 


CD Audio HUC 


44100kbps 


None 


Hardware 


1 


CD Audio SE C 


44100kbps 


None 


Software 


2 


CD Audio 


44100kbps 


None 


None 


3 


CDR Audio 


44100kbps 


None 


None 


4 


CDR Made From MPS 


44100kbps 


mp3 


None 


5 


MP3 File 


160kbps 


mp3 


None 


6 



[0046] Fingerprints dynamically gathered may contain information that helps validate quality. 
Information sich as errors while reading from the media may be sent up to the fingerprint 
collector. The system may reject fingerprints that had high error rates from the source media. 

[00471 As not 3d above, instead of immediately storing a fingerprint, multiple fingerprints for a 
recording ma^ be gathered in by a fingerprint collection server prior to being added to the 
database. Th sse fingerprints may be compared algorithmically to determine their correlation. If 
correlation is riot adequate thon additional fingerprints may be gathered until adequate 
con-elation is nchieved and one of the fingerprints or a composite fingerprint is stored in the 
database. Th s prevents bad fingerprints from becoming part of the database. 
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[0048] Stitching cf the segmented fingerprints may be necessary since slight variations in tinning 
could result in ove nap of the fingerprints. Algorithmic stitching could result in a higher quality 
continuous fingerprint Simple stitching appends segmented fingerprints in order of appearance 
in the recording. Complex sttlching could Involve scaling different qualities of fingerprints to the 
lowest common denominator and then appending them in order of their appearance in the 
recording. Preferably some form of mathematical fitting Is utilized If the fingerprint segmentation 
contains jitter, so that appending Is a fuzzy process rather simple addition of the datastream. 

[0049] One exarr pie of audio fingerprinting that can be used is described In the U.S. patent 
application entitled Automatic Identification of Sound Recordings, filed by Maxwell Wells et al. 
on July 22, 2002 jnd incorporated herein by reference. However, any known algorithmically 
derived fingerprinting technique may be used, not only for digital audio, but also video, TV 
programs (both aialog and digital) and DVDs. Appropriate identifiers and recognition 
techniques will be used for Hie media to be recognized In a particular application. 

[0050] The present invention provides great flexibility and can be utilized for a wide variety of 
environments. Including MP3 recognition in a peer-to-peer environment, or Identification of an 
audio stream for monitoring and reporting purposes. No other solution Is known to use multiple 
recognition comp>nents; so It is the only solution that can be customized to meet the needs of 
any audio (or vide o) recognition application. 

[0051] A functional description for a deployment of the present invention in a peer-to-peer 
application will be described below with reference to Fig. 3. In this embodiment, audio files are 
identified before providing public access to them, to determine If the files are allowed in the 
system, a process known as ^ller-in". 

[00521 Client device 110 (Fig. 1) extracts information 310 (Fig. 3) from an audio file at the time 
of upload to server 120 (Fig. 1). The extracted Information preferably includes non-waveform 
data, such as a unique ID, IDS tag. filename text data, track duration, etc and flngerprint(s) 
extracted from tho recording and sent to server 120 for recognition. 

[0053] The Initial match 320 Is performed against the unique ID, if present. Use of Gracenote's 
TUID enables a match to be returned with 99.9% accuracy. This is also the least resource 
Intensive recognition method and can achieve very fast recognition rates. If the unique ID is 
present Ihe syste n moves to the validation stage. If no unique ID is present the system 
attempts identification using the next recognition methods 330. 
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[0054] In this embodiment, text-based Identification is tried next, using a metadata database, 
such as the Gracenote CDDB service which contains over 900,000 albums and over 12 million 
songs. Text Hatching utilizes available text, such as the filename, file path or text within the ID3 
tag for MP3 fl es, to provide a set of data from which to attempt recognition . If an acceptable 
match Is returned, the system moves to the validation stage. If a successful match Is not 
returned, the system attempts identification utilizing the next recognition method. 

[0055] The noxt step Is fingerprint identification, in this case using audio fingerprints. The 
fingerprints from an unknown recording are compared to the fingerprints In database 90 for 
reference recordings, one fingerprint at a time (or in parallel using different processors for 
different fingerprints). Each fingerprinting technology returns a match and a level of confidence. 
If a single reference recording has acceptable confidence levels the system moves to the 
validation sta<je. If an unsuccessful match Is returned the system can, depending on the target 
application, a;;k the user for validation of the most likely result or it can return a "no match 
found" result. 

[0056] Valida Ion Is a key component to any successful recognition system. Preferably, key file 
attributes such as the duration of the recoding, are used to validate that a file Is what the 
recognition system says it is by comparing an extracted length of the unknown recording with a 
stored length af the single reference recording. 

[0057] Preferably heuristic and voting algorithms 340 are used to determine rf a match is what 
the system says it is. This self-monitoring reduces the possibility that the system returns 
Inaccurate da" a that pollutes the system. The heuristics may be manually controlled or 
algorithmically controlled to produce the best match. These heuristics may also be used to 
determine which recognition techniques to apply and In what sequence. 
[0058] The administrator of each application can determine the level of accuracy needed by 
each stage (o component) of the system, and therefore has explicit control in optimizing the 
system. For example, if a 90% aggregate match Is required the system administrator can use 
administrative interfaces 130 to adjust the levels of acceptable return to 90% and a successful 
result will not l» generated unless that threshold is met The administrator can also set result 
levels for each component. For example, a 99% text match can be required but only an 85% 
audio flngerpr nt match. 
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[0059] Once a successful identification is returned the file will be retagged 350 with the unique 
ID allowing for population of the file with the correct ID throughout the system. As a result, 
future identification of the file will require the least resource Intensive recognition method. 

[0060] The urlque ID (TUID) assigned to the file is then matched 360 against a list 370 of 
TUIDs popula ed through the submission of Title/Artist pairs 370 by labels, publishers, and 
content owners of those files allowed in the system. In one embodiment, tf the TUID Is present 
in the database, the file is allowed to be shared, but if the TUID Is not present in the database, 
the file is blocked. In another embodiment, if the TUID Is present In the database, the file Is 
blocked. Eithor of these embodiments could be applied to files recognized as they are 
accessed by c user, or transmitted from one computer to another. 

[0061] As illustrated in Fig. 4A, an embodiment, of the present Invention uses a plurality of 
related databeses. Master metadata database 410 contains information on title, artist/author 
name, owner name and date. Related databases include audio fingerprint database 430 and 
video fingerprint database 440 which form fingerprint database 290 (Fig. 2). Also included are 
track length/TOC database 450, text database 460, and hash ID database 470 and guaranteed 
unique ID database 480. 

[0062] As illustrated in Fig. 4B, when unidentified (unknown) recording 100 is accessed by 
client device 110, information is extracted, including fingerprints 540, 550, metadata 560 and 
unique ID 570, if present. In addition, the duration 580 of the recording is determined and a 
numerical hash 590 is calculated. The extracted fingerprints are compared with fingerprints 
BOO, 610. Similarly, matching 620, 630, 640 Is performed on the numerical hash, text and 
unique ID. If h reference recording is located, validation is performed by comparing the duration 
of unidentified recording 100 with the duration of the reference recording. Results 660-710 with 
a level of conf dence for each method of comparison is supplied to result aggregator 730. 

[0063] If no reference recording is found 750 matching unidentified recording 100, the extracted 
Information 540-590 and results are stored in unrecognized holding bin 760 for periodic 
resubmission :o recognition server 120 (Figs. 2 & 4B). In this embodiment, If a reference 
recording is located 770 with a low aggregate confidence level, post recognition processing 780 
is performed ty applying heuristics 790, or a manual review 810, e.g., by presenting one or 
more possible matches to the user and receiving the user's selection In response. The results 
of such user selections may be Included in the heuristics stored in heuristics database 820. If 
post recognltk>n processing 780 results in identification of a single reference recording or result 
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aggregator 730 outputs recognized results 770 with a high aggregate confidence level, the hash 
ID Is generated 810 and sent to hash database 480 and client device 110, so that the hash and 
unique ID (TUID) can be stored in the 1D3 tag, if a file is being created. 

[0064] In one embodiment, the system learns by watching errors in repeated attempts at 
recognition of simitar flies to Improve Its results. II also may receive manual stimulus from users 
who indicate thut there are errors in the results. This allows recognition to be continuously 
validated over time. For example a file could be recognized by a system according to the 
invention, then over time the system determines that recognition of that file was flawed, and 
indicates to an operator that there was something wrong. In another embodiment, the system 
determines what is wrong by monitoring non-fingerprint based data and changing the 
recognition results accordingly. 

[0065] The present invention can be utilized to Identify any audio content for tracking purposes. 
Digital audio smjams. analog inputs or local audio files, can all be tracked. Such a tracking 
system could be a server side tracking system-deployed at the point of audio delivery and 
integrated with & reporting, digital rights management (DRM) system, or rights payment system, 
tf the audio contant being tracked was from a non-participating third party a client version of the 
system may be deployed to monitor the content being distributed. In either case, multiple 
identification methods would be utilized to ensure the highest rate of accuracy. 
[0068] Utilizing waveform recognition as a digital rights management component is possible, 
and can be deployed to compare user created digital audio files with lists of approved content. 
This enables a filter-in approach within a peer-to-peer file sharing architecture such as the one 
described above. 

[0067] Audio fingerprinting technologies can be used as an anti-piracy tool, and can be 
customized to tha type of audio being investigated. In the case of pirated CDs, the Gracenote's 
CDD8 CD service may be utilized to provide table of content (TOC) recognition to augment 
audio fingerprinting technologies. 

[0068] Identlfica ion is the enabling component to deliver value-added services. Without explicit 
knowledge of the content being distributed it is Impossible to distribute value-added content and 
services that relstes to that audio content. 

[0069] The many features and advantages of the Invention are apparent from the detailed 
specification and thus, It is Intended by the appended claims to cover all such features and 
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advantages of the invention that fall within the true spirit and scope of the invention. Further, 
since numerous modifications and changes will readily occur to those skilled In the art, it is not 
desired to limit the invention to the exact construct on and operation illustrated and described, 
and accordingly all suitable modifications and equivalents may be resorted to, falling within the 
scope of the invention. For example the system and method have been described as using a 
unique Identifier, h owever, a hashed Identifier could be used instead. 



15 



(36) 



JP 2004-537760 A 2004.12.16 



WO 03/012695 PCT/DS02/24054 

CLAIMS 

What Is de lined Is: 

1. A methixJ of Identifying recordings, comprising: 

extracting information about an unknown recording stored In media possessed by 
a user and at leas : one algorrthrnically determined fingerprint from at least one portion of the 
unknown recording; 

detarmining a possible Identification of the unknown recording using at least one 
piece of Ihe information extracted from the unknown recording and an identification database of 
corresponding information for reference recordings; and 

Ideitfying the unknown recording when the possible identification based on each 
of the at least one piece of the Information in combination with the at least one akjorithmically 
determined fingerprint Identifies a single reference recording with respective confidence levels. 

2. A methDd as recited in claim 1, 

wherein the Identification database is maintained by a provider of identification 

services, and 

wharein said determining uses a unique identifier from the provider of 
identification serv ces when the unique identifier is associated with the unknown recording and 
otherwise uses text associated with the unknown recording when text is associated with the 
unknown recording. 

3. A method as recited in claim 2. further comprising validating said Identifying by 
comparing an ext acted length of the unknown recording with a stored length of the single 
reference recording. 

4. A method as recited in claim 3, wherein the text associated with the unknown 
recording includes u filename of the recording. 

5. A method as recited in claim 3, wherein the text associated with the unknown 
recording include:} an 1D3 tag for the recording. 

6. A method as recited In claim 1 , wherein the at least one akjorithmically determined 
fingerprint Is extre cted from at least one of audio and video information in the at least one 
portion of the unkiown recording. 
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7. A method as recited In claim 1 , 

wherein the at least one algorithm ically determined fingerprint Includes at least 
twofingerprinls, and 

wherein said identifying requires each of the at least two fingerprints to identify 
the single reference recording with respective confidence levels. 

8. A rr ethod as recited in claim 1, further comprising validating said Identifying by 
comparing an extracted length of the unknown recording with a stored length of the single 
reference recording. 

9. A n ethod as recited in claim 8, further comprising: 

repeating said extracting, determining and Identifying for a plurality unknown 
recordings fro n a plurality users; 

monitoring unsuccessful identifications of the unknown recordings; and 
detecting a possible error In the identification database from a pattern of errors. 

10. A nethod as recited in ciairn 9, wherein said monitoring includes receiving 
information frcm the users indicating that said identifying was Incorrect. 

11. A method as recited in claim 9. 

wherein said monitoring in dudes storing the at least one algorithmically 
determined firgerprint and an Identifier of the single reference recording when said validating is 
not successfu , and 

wherein said method further comprises Indicating the possible error In the 
identification catabase when substantially different fingerprints are stored for a single identifier. 

12. A nethod as recited in daim 9, wherein said method further comprises indicating 
the possible e tot when the at least one algorithmically determined fingerprint matches one of 
the reference ecordings, but the unknown recording is associated with ID3 Tag information 
different from hat of the one of the reference recordings. 

13. A method as recited in claim 9, further comprising correcting the possible error 
based on the information extracted from the unknown recordings. 
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14. A method as recited in claim 8, farther comprising indicating a possible error in the 
Identification database when the at least one akjorithmlcally determined fingerprint is 
substantially slnllar to one of the reference recordings, but substantially different information is 
extracted from the unknown recording. 

15. A method as recited in claim 1, further comprising delivering related data for the 
unknown recorc ing from a supplemental database to supplement data embedded within the 
unknown recorc ing for display and user manipulation. 

16. A method of identifying recordings, comprising: 

extracting fingerprints from at least one portion of an unknown recording using a 
plurality of algorithms; 

cetermining a possible idBntificatkxi of the unknown recording using at least two 
of the fingerprints extracted from the unknown recording and at least one database of 
correspondingly generated fingerprints for reference recordings; and 

klentifying the unknown recording when the possible identification based on each 
of the fingerprints identifies a single reference recording with respective confidence levels. 

17. A method as recited in claim 16, wherein each fingerprint is extracted from at least 
one of audio an i video information in the at least one portion of the unknown recording. 

18. A method as recited in claim 16, further comprising validating said Identifying by 
comparing a lergth of the unknown recording with a stored length of the single reference 
recording. 

19. A method as recited in claim 18, 

wherein said extracting is performed by client equipment possessed by a user, 
wherein said determining, identifying and validating are performed by at least one 

server under coitro) of a provider of Identification services, and 
wherein said method further comprises: 

transmitting a unique identifier associated with the single reference 

recording from tie at least one server to the client equipment after said validating is successful; 

and 
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associating the unique identifier with the unknown recording in the client 



equipment. 



20. A method as recited in claim 19. further compnsing: 

comparing the unique identifier with a permission list of stored identifiers in the at 
least one database*; 

Indicating that Ihe recording may be shared if there is a match for the unique 
identifier in the permission list 

21. A method as recited in claim 19. further comprising: 

comparing the unique identifier with a block list of stored identifiers in the at least 

one database; 

indi =atlng that the recording may not be shared If there Is a match for the unique 
identifier in the block list 

22. A method of obtaining reference Information stored in a database used to Identify 
unknown recording, comprising: 

obtaining non-waveform data associated with a recording possessed by a user of 

the database for icentification of recordings possessed by the user; 

extracting at least one fingerprint from at least one portion of the recording; and 
storing the at least one fingerprint as identifying information for the recording, 

when a match Is found In the database for the non-waveform data. 



23. A method as recited in claim 22, wherein tha non-waveform data indicates the 
length of the recording. 

24. A method as recited in claim 23, wherein the recording is permanently stored on a 
removable medlun and the non-waveform data is derived from table of contents data for the 
recording. 

25. A method as recited in claim 22, wherein the non-waveform data Includes text 
associated with ths recording. 
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26. A method as recited in claim 25, wherein the non-waveform data includes and ID3 

tag. 

27. A method as recited in claim 26, 

wherein the ID3 tag includes encoded Information, 

wherein the database is maintained by a provider of identification services and 
the encoded nformatlon Is generated under control of the provider of identification services, and 

wherein said method further comprises validating the non-waveform data by 
decoding the encoded information prior to said storing of the identifying information in the 
database. 

26. A method as recited in claim 25, wherein the non-waveform data includes a 
watermark. 

29. A method as recited In claim 25, wherein the non-waveform data Includes media 
information regarding source media type. 

30. A method as recited in claim 29, wherein the media Information identifies the source 
media type a? CD-R. 

31 . A method as recited in claim 29, wherein the media information identifies the source 
media type a > CD-DA. 

32. A method as recited in claim 29, wherein the media information Identifies the source 
media type as a digital file. 

33. A method as recited in claim 29, wherein the media informanon identifies the source 
media type a i a digital versatile disc. 

34. A method as recited in claim 25, wherein the text includes a filename of the 
recording. 

35. A method as recited in claim 25, wherein the text includes a title of the recording. 
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36. A method as recited In claim 25, wherein the text includes an artist name of a 
participant In creation of the recording. 

37. A method as recited in claim 25, wherein the text includes an album name 
associated with the recording. 

38. A m athod as recited in claim 22, wherein said obtaining and extracting are 
performed by client equipment possessed by a plurality users for different copies of the 
recording and d fferent users extract different fingerprints from the recording. 

39. A mathod as recited in claim 38, further comprising: 

maintaining the database on at least one server under control of a provider of 
identification sei vices, and 

ti ansmitting from the at least one server to the client equipment, extraction 
instructions on v/hlch of the different fingerprints each of the client equipment extracts. 

40. Am 3thod as recited in claim 39, further comprising: 

transmitting the non-waveform data from the client equipment to the at least one 

server; and 

s alerting the extraction instructions by the at least one server for said 
transmitting to the client equipment based on the non-waveform data. 

41 . A m jthod as recited in claim 40, further comprising updating the extraction 
instructions basod at least In part on frequency of receipt of the non-waveform data for the 
recording. 

42. A muthod as recited in claim 40, wherein said selecting of the extraction instructions 
Is based at leasl in part on type of the client equipment receiving the extraction instructions. 

43. A rmthod as recited In claim 40, wherein said selecting of the extraction instructions 
is based at leasl in part on geographical location of the client equipment receiving the extraction 
instructions. 
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44. A method as recited in claim 40. wherein said selecting of the extraction instructions 
is based at leest In part on software operating on the client equipment receiving the extraction 
instructions. 

45. A method as recited in claim 40, further comprising updating the extraction 
instructions bt sed at least in part on number of users who have supplied the Identifying 
information. 

46. A method as recited In claim 40, wherein said selecting of the extraction instructions 
is based at les st in part on quality of the copies of the recording. 

47. A method as recited In claim 40, further comprising transmitting the at least one 
fingerprint fron the client equipment to the at least one server at a time specified by the 
extraction instuctlons. 

48. A method as recited In claim 47, further comprising storing the at least one 
fingerprint at the client equipment until a specified number of fingerprints are ready for said 
transmitting. 

49. A method as recited in claim 47, wherein said transmitting of tne at least one 
fingerprint occ jrs when a communication channel with the at least server is available. 

50. A method as recited In ctalm 47, wherein said transmitting of the at least one 
fingerprint for u first recording accessed by a piece of client equipment occurs with said 
transmitting ol the non-waveform data for a second recording accessed by the piece of client 
equipment. 

51 . A method as rocited in claim 47, 

wherein the recording is permanently stored on a removable medium and the 
client equipment generates at least one encoded file from the recording, and 

wherein said transmitting transmits the at least one fingerprint before encoding 

tne recording. 

52. A method as recited in claim 47, 
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therein ttie recording Is permanently stored on a removable medium and the 
client equipme it generates at least one encoded file from the recording, and 

wherein said transmitting transmits the at least one fingerprint after encoding one 
track of the renovable medium. 

53. A method as recited In claim 47, 

wherein the recording is permanently stored on a removable medium and the 
client equipment generates at least one encoded file from the recording, and 

wherein said transmitting transmits the at least one fingerprint after receiving an 
Indication that 9ncoding of the removable medium has been completed. 

54. A method as recited in claim 22, wherein the database includes the Identifying 
Information for musical recordings. 

55. A method as recited in claim 22, wherein the database includes the identifying 
Information for video recordings. 

56. A method as recited in claim 22, further comprising: 

detecting a quality of the at least one fingerprint; 

identifying another copy of the recording using the at least one fingerprint; and 
replacing the at least one fingerprint with a higher quality fingerprint when the 
other copy of tie recording produces the higher quality fingerprint. 

57. A method as recited in claim 56, wherein said detecting of the quality is based on an 
encoding tech n'que used for the recording. 

58. A method as recited in claim 56. wherein said detecting of the quality is based on a 
media type us sd to store the recording. 

59. A nethod as recited in claim 56, wherein said detecting of the quality is based on 
error correctioi capability of user equipment accessing the recording. 
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60. A -nethod as recited in dalm 59, wherein said detecting of the quality assigns higher 
quality when r ardware error correction is used than when software error correction is by the 
user equipment. 

61. A nethod as recited In claim 56, wherein said detecting of the quality Is based on 
number of errors detected during said extracting of the fingerprint. 

62. A method as recited in claim 22, 

wherein said obtaining and extracting are performed by client equipment 
possessed by a plurality users for different copies of the recording, and 
wherein said method further comprises: 

comparing the at least one fingerprint obtained from one of the users with 
the at least on i fingerprint extracted from at least one other user and 

updating the at least one fingerprint fn the database based on said 

comparing. 

63. A rrtethod as recited in claim 62, wherein said updating is performed after said 
comparing determines that fingerprints from different users have a predetermined correlation. 

64. A nethod as recited In claim 62. wherein said updating combines fingerprints from 
different users for storage in the database. 

65. A system for Identifying recordings, comprising: 

an extraction unit to extract information. about an unknown recording stored in 
media possessed by a user and at least one slgorfthmlcally determined fingerprint from at least 
one portion of ihe unknown recording; and 

m identification unit, coupied to said extraction unit, to make a possible 
Identification ol the unknown recording using at least one piece of the information extracted from 
the unknown re cording and an identification database of corresponding information for 
reference recoidlngs, and to identify the unknown recording when the possible Identification 
based on each of the at least one piece of the infonnation in combination with the at least one 
algorithmically ■ietermlned fingerprint identifies a single reference recording with respective 
confidence leve Is. 
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66. A system for identifying recordings, comprising: 

an extraction unit to extract fingerprints from at least one portion of an unknown 
recording ushg a plurality of algorithms; and 

an identification unit, coupled to said extraction unit, to make a possible 
identification of the unknown recording using at least two of the fingerprints extracted from the 
unknown recDrdlng and at least one database of correspondingly generated fingerprints for 
reference recordings, and to identify the unknown recording when the possible identification 
based on ea<*i of the fingerprints identifies a single reference recording with respective 
confidence kvels. 

67. A system for obtaining reference information stored in a database usBd to identify 
unknown recordings, comprising: 

a receiving unit to obtain non-waveform data associated with a recording 
possessed b/ a user of the database for identification of recordings possessed by the user; 

, an extraction unit to extract at least one fingerprint from at least one portion of 
the recording ; and 

a storage unit, coupled to said receiving unit and said extraction unit, to store the 
at least one lingerprint as identifying information for the recording, when a match is found in the 
database for the non-waveform data. 



25 



(46) 



JP 2004-537760 A 2004. 12. 



WO 03/01 IW5 



PCT/USM/24054 




(47) 



JP 2004-537760 A 2004. 12. 16 



WO 03/012695 



PCT/DS02/24054 



S 

"E 


ir 


J 


Digital 


I 
1 


C ljj 


cz 
3 


6' 




(48) 



JP 2004-537760 A 2004.12.16 



WO 03/011695 



PCT/US02/24054 




(50) 



JP 2004-537760 A 2004. 12. 16 



WO 03/012695 



PCT/US02/24054 



F>5 



CD CO CD 



8 8 



li 

ii 



•pi 



^ "D -o 



t-CMZ 

e-e-e- 

(D Q> (D 

[rizir 



5* 



li 

0) TO 

2 



as g> 

p 

T 



3 



i 



1 






8 
5 




1 


±i 


8 


I 




(X 





Ci 



11 

o-g 

Is 



TO Q 



00 
CD 

LL 



(51) JP 2004-537760 A 2004.12.16 



WO03A>i::&¥5 i«CT/US»2/24054 
6f6 




(52) 



JP 2004-537760 A 2004.12.16 



(12) tNTERNATJONAI. APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 

(19) World Intellectual Property 
Organization 

International Bureau 



(43) International Publication Date 
13 February 2003 (13.02.2003) 



PCT 



(10) International PubUcatioa Number 

WO 2003/012695 A3 



(51) 

an 

(22) lab: 
(25) FlMog 
(26) 



(30) PrVirity Data: 

60/: 508,594 



PCT/US2002/024054 
31 July 2002 (31.07.2002) 



31 July 2001 (31.07.ZD01) US 



(71) Applicant: GRACENOTE, INC [US/USh 2141 4th 
Stoet, Berkeley. CA 94710 (US). 

(72) levators: KOBERTS, Dale, T.; 15 Oak Springs Drive, 
i San Anselmo, CA 94960 (US). HYMAN, David, 285 
: Lot Alios Drive, Kenungwrx, CA 94708 (US). WHITE, 
I Sicken 2326 McKintey Avenue, Berkeley, CA 94703 

; (115). 

' (74) A* at GOIAHOFER, Richard, A.; Staas & HaJsey 
| LLP, Suite 500, 700 Eleven* Street, N.W., Washington, 

5 dc aoooi (us). 



(SI) Designated State* (national): AB, AG. AL, AM, AT, AU, 

AZ, BA, BB, BG. BR. BY. BZ. CA. CH, CN, CO. CR. CU, 
CZ, DE. DK, DM, DZ, EC, EE, ES, PI, GB, OD, GR, OH. 
GM, HR, HU. ID, IL, IN, IS, JP, KE, KG, KP. KR. KZ, LC, 
LK, LR, LS, LT, LU. LV, MA, MD, MG, MK, MN, MW, 
MX, MZ. NO, NZ, OM. PH, PL, PT, RO, RU, SD, SE, SO, 
SI, SK, SL, TI, TM. TN. TR, TT, TZ, UA, UG, UZ, VN, 
YU, ZA, ZM, ZW. 

(84) Designated States {rzgionaik ARIPO patent (GH. GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM. ZW>, 
Eurasian patent (AM. AZ, BY, KG, KZ, MD, RU. TJ, TM). 
European patent (AT. BE, BG, CH. CY, CZ, DE, DK, EE, 
ES, Fl, FR, GB, GR, IE, IT. LU, MC, NL, PT, SE SK, 
TR), OAPI patent (BF, BJ. CF, CG. CI, CM, GA, GN, GQ, 
GW. ML. MR. NE. SN, TD, TGX 




f (54) TJU ;! MULTIPLE STEP IDENTIFICATION OF RECORDINGS 



in 




n unknown recording and ii 



5 (5?) Abstract; Multiple information is extracted from 
3 information includes the filename, if the recording is a 

I recoidinf it on a removable medium, such as a compact disc. At least one and preferably several algorilhmicilly determined fin- 



associated therewith. Associated 
file ai. e.g, MP3 format, or table of contents (TOO data, if the 



(53) 



JP 2004-537760 A 2004. 12. 16 



a m a m & i 

INTERNATIONAL SEARCH REPORT 



| 7wi?c^/24054 



Aaoortng to WnnHoiif Patenl C<— ifcttan (IPC) or to boWi national etonaaon *r*t IPC 



B. R ELDS SEARCHED 



iaik>ntotlM«Manitv«iiuerid<K«mntBmliioU(M in me neloe searched 



e consulted during t» International March (Mm* of aetibaMand. whm practical aaarch twrr» uwd) 



EPO-Inte.nal 



CllaUorf ot document, win hdkalkw, where appropriate, oftfie m 



Relevant to deim No. 



EP 0 319 567 B (MCS PARTNERS) 
14 June 1989 (1989-06-14) 



page 2, line 3,5,28,29 
page 3, line 22 

page 4, line 17 -page 5, line 4 
page 5, line 46 -page 6, line 32 
page 8, line 30 



1,6,7, 
15-17, 
65,66 
2,15 



|X~| PatoM femlyrrwrtWSaniMadkta/inv 



■A' <tecwnyitdtlr»a tha genu) arte of me an which Is not 

eonstosrodio be el particular arfovane* 
'E* earter doctrt ent but publahad on or after Ihe mternallorml 

V document »*idi may throw doubt* on priority Gtaxn(s) or 
which boUd to m3bM»ti Ihe pittka&n data of another 
clUtlDncraliarapacjajTB. — ^ 

'CT draaietitrverrlnaloanof 



latar document piiblehed alter Ihe Int 
or prkwHy date and nol In eonfloi wtU. ... . 
cMu uno^istendthoprtKtplaorttiooiy utdertybg out 



"X" documentor partaier 
oe»nol be considered 
Invoke an rwentlve at 

"V document of particular 



a slap tttwn the 
lar audidocu- 
t person sidled 



19 November 2003 



15/12/2003 



iSl?S5o p hv RteSr PB 5816 Palw "' 

T * (+31 -70) 340-20*0, Tx. 31 661 apo nl 
F« (431-70) MtHSOTd 



Autiortzed officer 



Bykowskl, A 



fan PCT/WWO |» and M Lba/ iwa) 



(54) 



JP 2004-537760 A 2004. 12. 



INTERNATIONAL SEARCH REPORT 



PCT/US 02/24054 



C4CoBUmMUon) DOCUMENTS CONSfDBRGO TO Be RELEVANT 



CiBten of "tocunertt, *H 



Rctavnit (o cMm No. 



W0 01 28222 A (TAN6 JIMMY TAI KWAN ;LAI 

SAI KIT (CN); NG KIN PING (CN); TSUI CHI) 

19 April 2001 (2001-04-19) 

page 1, line 8-10 

page 4, line 8-24 

page 5, line 20 -page 6, line Z 

page 15, line 9 -page 16, line b 

page 17, line 6-8 

page 28, line 21,22 

page 30, line 1 -page 32, line 29 

W0 98 25269 A (THOMSON CONSUMER 
ELECTRONICS) 11 June 1998 (1998-06-11) 

page 3, line 12 -page 4, Tine 37 
page 5, line 22 -page 6, line 11 
figures 3,4 
page 8, line 8-12 

"November 2000" 
THE MUSICBRAINZ MAILING LIST ARCHIVE, 
'Online! December 2000 (2000-12), 
XP002262122 

Retrieved from the Internet: 

<URL: http://xww.iBUs1cbra1n2.org/p1perma1l/ 

iiu s 1 cbral nz/2000-Nov ember . txt . gz> 

'retrieved on 2003-11-15! 

page 16, line 14,15 

page 38, line 17,18 

page 65, line 3-8 

page 77, line 24-32 

page 83, line 15 -page 86, line 10 

page 88, line 7-25 

US 5 918 223 A (KEISLAR DOUGLAS F ET AL) 

29 June 1999 (1999-06-29) 

column 1, line 61-66 -column 2, line 51-60 

column 3, line 56-67 

column 5, line 53 -column 6, line 10 

column 6, line 43,44 

coUmn 15, line 30-34 

colimn 17, line 20,21 

colLflin 22, line 10-16 



22-26, 
28-37, 
54,55 
2,15 



1,6,7, 
15-17, 
65,66 



22-64,67 



1-22,65, 
66 



1-67 



n ol MMftf IBM) 



(55) 



JP 2004-537760 A 2004. 12. 16 



INTERNATIONAL SEARCH REPORT 


Intamst to r^^ifM teuton No 

PCT/US 02/24054 


Pale it document 
citftd lr March report 


PuUteaUon 
dale 


Patent famiryt 
ir»mb*f(a) 


PubltcaHon 
date 



EP 0319567 


B 


14-06-1989 


US 


4843562 


A 


27-06-1989 








AT 


85735 


T 


15-02-1993 








AU 


2075288 


A 


19-01-1989 








All 


613941 


B2 


15-08-1991 








BR 


8807105 


A 


17-10-1989 








CA 


1290063 


C 


01-10-1991 








DE 


3878423 


Dl 


25-03-1993 








DE 


3878423 


T2 


26-08-1993 








EP 


0319567 


Al 


14-G6-1989 








ES 


2012834 


A6 


16-04-1990 








HK 


1000982 


Al 


15-05-1998 








IL 


867D1 


A 


25-05-1992 








OP 


2500875 


T 


22-03-1990 








JP 


3001896 


B2 


24-01-2000 








KR 


9600152 


Bl 


03-01-1996 








MX 


166116 


B 


21-12-1992 








WO 


8810540 


Al 


29-12-1988 


WO 0128222 


A 


19-04-2001 


AU 


2018201 


A 


23-04-2001 








WO 


0128222 A2 


19-04-2001 


W0 9825269 


A 


11-06-1998 


us 


6034925 


A 


07-03-2000 








us 


6031795 


A 


29-02-2000 








AU 


7627398 


A 


29-06-1998 








CN 


1284721 


A 


21-02-2001 








CN 


1284722 


A 


21-02-2001 








CN 


1239573 


A 


22-12-1999 








DE 


69716632 


Dl 


28-11-2002 








DE 


69716632 


T2 


31-07-2003 








EP 


1152421 


A2 


07-11-2001 








. EP 


0941537 


Al 


15-09-1999 








JP 


2001506795 


T 


22-05-2001 








JP 


2001313892 


A 


09-11-2001 








KR 


2000057236 


A 


15-09-2000 








WO 


9825269 


Al 


11-06-1998 








US 


6252831 


Bl 


26-06-2001 








us 


6226235 


Bl 


01-05-2001 








JP 


2001273748 


A 


05-10-2001 



US 5*18223 A 29-06-1999 NONE 



(56) 



JP 2004-537760 A 2004.12.16 



(Sl)mfem AP(GH,GM,KE f LS,MW,MZ,SD,SL,SZJZ,UG,ZM,ZW),EA(AM f AZ,BY,KG,KZ t MD,RUJJ ,TM),EP(AT, 

BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI ,FR,GB,GR, IE, IT,LU,MC,NL,PT,SE,SK,TR) ,0A(BF,BJ ,CF,CG,CI ,CM,GA,GN,CQ,GW, 
ML,MRJE,SNJDJG),AE,AG,AL > AM,AT,AU,AZJA,BB,BG t BR,BY,BZ,CA,CH,CN,CO,CR,CU,CZ,DE,DK,DM,DZ t EC,EE,ES, 
FI ,GB,GD,GE,GH,GM,HR,HU, ID, IL, IN, IS JP,KE,KG,KP,KR,KZ t LC,LK,LR,LS,LT,LU,LV,MA,MD,MG,MK,MN,MW,MX,MZ,N 
0,NZ,OM,PH,PL,PT,RO,RU,SD,SE,SG,SI,SK,SL,TJ,TM JN,TR,TT,TZ,UA,UG,UZ,VN,YU,ZA,ZM,ZW 

7;<»J*^B *«;7t;l/^7ffl 9 4 7 0 8 ^y^hV nX7^hXK7^^ 285 

7;< U *U7*;1/-7WI 9 4 7 0 3 M-'J'W ^^I/U — T^x— :x — 2 3 

2 (5 

5D015 AA03 BB02 CC17 KK02 LL07 

(54) mw<D&m m^<D&®mmm&ttim(DmM&m*mmiis ^^^^^(o^mmmi^m^xf^x 
t-aj trnzftrcKmifcthmme 0/3 0 s, 594^ mmm : ^-^t. d;<-7 (d a 1 

e T. Roberts) 6, : 2001^7^310) iCMU cn«tt«±St§ 



